Abstract
Background: Can we find a different architecture that matches Transformers on key indicators? In what ways are they similar/different?
Methods:
- Identify indicator tasks that only Transformers excel at (e.g. The Copying Task)
- Design an all-MLP architecture that passes the indicator tasks
- Identify contributing factors
Results: Text for this section.
- Members: Mirali Purohit, Gedeon Muhawenayo, Esther Rolf, Hannah Kerner
Introduction
Methods
Information about software and data
Reviewers and readers of a research paper must be able to use the used software and data to reach the same Results. Journal of Cheminformatics will only publish research or software that is entirely reproducible by third parties. This means that any datasets, software and algorithms that are required to reach the conclusions stated in the paper must be provided as supplemental materials, or be otherwise accessible without the need for registration, login or agreement with license terms other than Creative Commons licenses for data and text and OSI-approved Open Source Licenses for software. For any software, the source code must be provided [@agrees_with:Guha_Willighagen_2017].
Adding References
References are added to the content in a similar way as LaTeX and there is a bibliography.bib
in this folder in the BibTeX format. A citation is made by including an \@ followed by the BibTeX key in square brackets, for example like [\@Upper_writers_1974] for Ref. [@Upper_writers_1974].
Figure 1: Reference list as converted into Word, including CiTO annotation.
Results
Figures are easy to add in Markdown, and can be done with the 
syntax.
Discussion
In this section we examine the growth rate of the mean of $Z_0$, $Z_1$ and $Z_2$. And we can have LaTeX equations:
\[x+1 = 2\]Conclusions
List of abbreviations
Availability of data and materials
TODO
Competing interests
TODO
Funding
TODO
Authors’ contributions
TODO
Acknowledgements
TODO
Authors’ information (optional)
TODO