Building a Good Foundation Model

 · 2 mins read

Abstract

Background: Assessing how the spatial distribution (in terms of diversity, spatial distribution, and representivity) of pre-training data affects self-supervised geospatial foundation models.

Building a Good Foundation Model

Methods:

  • Exploring how different pre-training data sampling strategies affect model performance on downstream task
  • Which strategies helps to achieve better performance in few-shot setting

Results: Text for this section.

  • Members: Mirali Purohit, Gedeon Muhawenayo, Esther Rolf, Hannah Kerner

Introduction

Methods

Information about software and data

Reviewers and readers of a research paper must be able to use the used software and data to reach the same Results. Journal of Cheminformatics will only publish research or software that is entirely reproducible by third parties. This means that any datasets, software and algorithms that are required to reach the conclusions stated in the paper must be provided as supplemental materials, or be otherwise accessible without the need for registration, login or agreement with license terms other than Creative Commons licenses for data and text and OSI-approved Open Source Licenses for software. For any software, the source code must be provided [@agrees_with:Guha_Willighagen_2017].

Adding References

References are added to the content in a similar way as LaTeX and there is a bibliography.bib in this folder in the BibTeX format. A citation is made by including an \@ followed by the BibTeX key in square brackets, for example like [\@Upper_writers_1974] for Ref. [@Upper_writers_1974].

Now, the Journal of Cheminformatics support citation typing ontology annotations using the CiTO @uses_method_in:Willighagen_2020. Adding an annoted citation is done by prepending the BibTeX key with the intention, e.g. [\@agrees_with:Guha_Willighagen_2017] or [\@uses_method_in:Willighagen_2020].

If you have more than one reference to cite, separate them with a semicolon, for example: [\@Willighagen_2020; \@Guha_Willighagen_2017] [@Willighagen_2020; @Guha_Willighagen_2017]. If you have more than one intention to cite, separate them with a colon, for example: [\@uses_method_in:extends:Willighagen_2020] [@uses_method_in:extends:Willighagen_2020].

Figure 1: Reference list as converted into Word, including CiTO annotation.

Results

Figures are easy to add in Markdown, and can be done with the ![](images/cito_in_Word.png) syntax.

Discussion

In this section we examine the growth rate of the mean of $Z_0$, $Z_1$ and $Z_2$. And we can have LaTeX equations:

\[x+1 = 2\]

Conclusions

List of abbreviations

Availability of data and materials

TODO

Competing interests

TODO

Funding

TODO

Authors’ contributions

TODO

Acknowledgements

TODO

Authors’ information (optional)

TODO

References