Create fetchers for ScholarAPI

[koppor]

!! This issue needs more thought. Take it only of you have time to 🧠 !!

ScholarAPI is a perfect Google Scholar alternative when programmatic access to full texts is needed. It is used by research teams and academic tool builders for broad bibliography searches, AI & LLM model training, building RAG knowledge bases, literature monitoring, plagiarism detection, etc. See here for details: https://scholarapi.net?via=outs

JabRef offers integrating such fetchers: https://devdocs.jabref.org/code-howtos/fetchers.html

The API is described at https://scholarapi.net/docs/api

• Implement org.jabref.logic.importer.PagedSearchBasedFetcher for https://scholarapi.net/docs/api#GET/list
• Implement org.jabref.logic.importer.FulltextFetcher using https://scholarapi.net/docs/api#GET/pdf/{id} (maybe routing via https://scholarapi.net/docs/api#GET/list to get the id)

You can look at org.jabref.logic.importer.fetcher.ArXivFetcher or other Fetchers implementing these interfaces for an implementation inspiration.

[thesauravpoddar]

/assign-me

[jabref-machine]

Thank you for your continued work in JabRef. At this point, you probably already know the basics and the important links. If not, our contributing guidelines is the place you should go to.

At this point in time, you raised 1 pull request(s) of which 100% (1/1) have been merged.

[thesauravpoddar]

hey @koppor So I looked at documentation of ScholarAPI and they
Use the last received indexed_at as a cursor in indexed_after to retrieve the next page of results.
which means we have to implement differently as dodne for springer fetcher or ArXivFetcher in which offset pagination is done and which is stateless rather in ScholarApi they are doing cursor pagination like to get page 5 we first have to get pages upto 4 which is different from springer or ArXivFetcher in which we just have to give the page number in
Page<BibEntry> performSearchPaged(BaseQueryNode queryNode, int pageNumber) throws FetcherException;
this is my observation correct me if i am wrong somewhere

[thesauravpoddar]

heyy @koppor I have a question

while Implementing `jsonItemToBibEntry` fields with REQUIRED are the fields that we will get everytime otherwise we may get other or we may not like there is NO REQUIRED tag on doi so for this i have to use if json entry has this otherwise just give an empty string for example

entry.setField(StandardField.ISSN, Optional.ofNullable(scholarJsonEntry.optJSONArray("journal_issn")).map(array -> array.getString(0)).orElse(""));

there is no REQUIRED TAG for journal_issn so if it is empty we will just give an empty string

[Siedlerchr]

@thesauravpoddar If a field is not present don't add it to the entry. see ZbMath or other fetchers how they do it.

[thesauravpoddar]

@thesauravpoddar If a field is not present don't add it to the entry. see ZbMath or other fetchers how they do it.

Okay thankyou