· 2 mins read

Abstract

Background: Can we find a different architecture that matches Transformers on key indicators? In what ways are they similar/different?

Using Relation Networks to Understand T/’s

Methods:

  • Identify indicator tasks that only Transformers excel at (e.g. The Copying Task)
  • Design an all-MLP architecture that passes the indicator tasks
  • Identify contributing factors

Results: Text for this section.

  • Members: Mirali Purohit, Gedeon Muhawenayo, Esther Rolf, Hannah Kerner

Introduction

Methods

Information about software and data

Reviewers and readers of a research paper must be able to use the used software and data to reach the same Results. Journal of Cheminformatics will only publish research or software that is entirely reproducible by third parties. This means that any datasets, software and algorithms that are required to reach the conclusions stated in the paper must be provided as supplemental materials, or be otherwise accessible without the need for registration, login or agreement with license terms other than Creative Commons licenses for data and text and OSI-approved Open Source Licenses for software. For any software, the source code must be provided [@agrees_with:Guha_Willighagen_2017].

Adding References

References are added to the content in a similar way as LaTeX and there is a bibliography.bib in this folder in the BibTeX format. A citation is made by including an \@ followed by the BibTeX key in square brackets, for example like [\@Upper_writers_1974] for Ref. [@Upper_writers_1974].

Figure 1: Reference list as converted into Word, including CiTO annotation.

Results

Figures are easy to add in Markdown, and can be done with the ![](images/cito_in_Word.png) syntax.

Discussion

In this section we examine the growth rate of the mean of $Z_0$, $Z_1$ and $Z_2$. And we can have LaTeX equations:

\[x+1 = 2\]

Conclusions

List of abbreviations

Availability of data and materials

TODO

Competing interests

TODO

Funding

TODO

Authors’ contributions

TODO

Acknowledgements

TODO

Authors’ information (optional)

TODO

References