Skip to content

Add support for Content-Signal - #52

Open
Anatoly03 wants to merge 2 commits into
temoto:masterfrom
Anatoly03:master
Open

Anatoly03 wants to merge 2 commits into
temoto:masterfrom
Anatoly03:master

Conversation

@Anatoly03

@Anatoly03 Anatoly03 commented Aug 26, 2026

Copy link
Copy Markdown

I've been following your style guide and wrote everything by hand (no agent). Also added two tests which verify the code works.

Motivation: There is a new protocol by Cloudflare that's fairly established on more modern websites which uses the Content-Signal parameter to specify how the content can be used by crawler. https://contentsignals.org/

Usage: I added a new method CanSearch() which returns true wether the crawler is allowed to retrieve the website information for a search index.

@temoto

temoto commented Sep 14, 2026

Copy link
Copy Markdown
Owner

thanks, i'm trying to convert it into single integer field for performance

@Anatoly03

Copy link
Copy Markdown
Author

thanks, i'm trying to convert it into single integer field for performance

Thank you for the response and for the project maintenance!

That's a good idea. You have write/ commit access on my branch, right?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants