when using scraper (/workspaces/NLWeb/code/scraping/incrementalCrawlAndLoad.py) having issues when josn-ld is in a @graph

[genericrobot77]

I have had success using this code on json-ld that is flat (not in a @graph), when I now point it at a list of URLs that all have json-ld graph it is failing 100%.

is this a known issue?

Example page json-ld:

from
https://www.healthdirect.gov.au/australian-health-services/healthcare-service/edensor-park-2176-nsw/synergy-health-and-wellbeing/chiropractor/7f905784-5624-f98d-cd6f-d366bbac67c1

{"@context":"https://schema.org","@graph":[{"@type":"MedicalOrganization","location":{"@type":"Place","address":{"@type":"PostalAddress","streetAddress":"249 Edensor Road","addressLocality":"EDENSOR PARK","addressRegion":"NSW","postalCode":"2176","addressCountry":"AUS"}},"medicalSpecialty":[{"@type":"MedicalSpecialty","name":"Chiropractor"}],"additionalProperty":[{"@type":"PropertyValue","name":"Free Parking","value":true},{"@type":"PropertyValue","name":"Wheelchair Access","value":true},{"@type":"PropertyValue","name":"Mixed Billing","value":true}],"name":"Synergy Health and Wellbeing","url":"https://www.healthdirect.gov.au/australian-health-services/healthcare-service/edensor-park-2176-nsw/synergy-health-and-wellbeing/chiropractor/7f905784-5624-f98d-cd6f-d366bbac67c1","@id":"https://www.healthdirect.gov.au/australian-health-services/healthcare-service/edensor-park-2176-nsw/synergy-health-and-wellbeing/chiropractor/7f905784-5624-f98d-cd6f-d366bbac67c1","ContactPoint":[{"@type":"ContactPoint","telephone":"02 9822 0588","contactType":"work"},{"@type":"ContactPoint","url":"http://synergyclinic.net/services/","contactType":"work"}]},{"@type":"Place","@id":"https://www.healthdirect.gov.au/australian-health-services/healthcare-service/edensor-park-2176-nsw/synergy-health-and-wellbeing/chiropractor/7f905784-5624-f98d-cd6f-d366bbac67c1","openingHoursSpecification":[{"@type":"OpeningHoursSpecification","dayOfWeek":"monday","opens":"09:00:00","closes":"19:30:00"},{"@type":"OpeningHoursSpecification","dayOfWeek":"wednesday","opens":"09:00:00","closes":"19:30:00"},{"@type":"OpeningHoursSpecification","dayOfWeek":"thursday","opens":"16:00:00","closes":"19:30:00"},{"@type":"OpeningHoursSpecification","dayOfWeek":"friday","opens":"09:00:00","closes":"19:30:00"},{"@type":"OpeningHoursSpecification","dayOfWeek":"saturday","opens":"07:30:00","closes":"10:00:00"}]}]}

CHeers

Josh A

[rvguha]

Can you share the error message? Or is it just not loading?

[genericrobot77]

@rvguha thank you for the response:

command:

root@e6a31d09111c:/workspaces/NLWeb/code# python -m scraping.incrementalCrawlAndLoad https://www.healthdirect.gov.au --sitemap https://raw.githubusercontent.com/genericrobot77/NLWeb/refs/heads/main/sitemap_clean.xml --max-pages 20 --db-name Service-Finder

In the crawl_status.json file created as I was crawling the output is mostly:

{ "bbb7dd9e30939a25bf1b192ad9d943c2": { "url": "https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea", "started_at": "2025-07-08T04:39:39.255923", "completed": false, "uploaded": false, "page_size": 237777, "fetched_at": "2025-07-08T04:39:40.151040", "html_file": "bbb7dd9e30939a25bf1b192ad9d943c2_australian-health-services_healthcare-service_prai.html", "error": "the JSON object must be str, bytes or bytearray, not NoneType", "completed_at": "2025-07-08T04:39:40.197786" },

here is the error log from my local terminal:

Processing sitemap: https://raw.githubusercontent.com/genericrobot77/NLWeb/refs/heads/main/sitemap_clean.xml
2025-07-08 04:39:40,197 - incremental_crawl_and_load - ERROR - error:151 - Error processing https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea: the JSON object must be str, bytes or bytearray, not NoneType
Progress: 1/20 (5.0%) | Success: 0 | Failed: 1 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: 02025-07-08 04:39:41,103 - incremental_crawl_and_load - ERROR - error:151 - Error processing https://www.healthdirect.gov.au/australian-health-services/healthcare-service/edensor-park-2176-nsw/synergy-health-and-wellbeing/acupuncture/09477770-6b52-348c-3e36-a46f04d562de: the JSON object must be str, bytes or bytearray, not NoneType
Progress: 2/20 (10.0%) | Success: 0 | Failed: 2 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: 02025-07-08 04:39:42,210 - incremental_crawl_and_load - ERROR - error:151 - Error processing https://www.healthdirect.gov.au/australian-health-services/healthcare-service/edensor-park-2176-nsw/synergy-health-and-wellbeing/massage-therapy/3f7b85c9-e601-0a9c-3c33-a0f886de942d: the JSON object must be str, bytes or bytearray, not NoneType
Progress: 3/20 (15.0%) | Success: 0 | Failed: 3 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: 02025-07-08 04:39:43,349 - incremental_crawl_and_load - ERROR - error:151 - Error processing https://www.healthdirect.gov.au/australian-health-services/healthcare-service/edensor-park-2176-nsw/synergy-health-and-wellbeing/chiropractor/7f905784-5624-f98d-cd6f-d366bbac67c1: the JSON object must be str, bytes or bytearray, not NoneType
Progress: 5/20 (25.0%) | Success: 0 | Failed: 5 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: 02025-07-08 04:39:45,009 - incremental_crawl_and_load - ERROR - error:151 - Error processing https://www.healthdirect.gov.au/australian-health-services/healthcare-service/edensor-park-2176-nsw/lam-practice-edensor-park/gp-general-practice/636e902c-6286-b89d-662e-5ad16e3107e8: the JSON object must be str, bytes or bytearray, not NoneType
Progress: 6/20 (30.0%) | Success: 0 | Failed: 6 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: 02025-07-08 04:39:46,385 - incremental_crawl_and_load - ERROR - error:151 - Error processing https://www.healthdirect.gov.au/australian-health-services/healthcare-service/edensor-park-2176-nsw/penna-s-pharmacy-edensor-park/electronic-prescribing/e5e31ceb-6626-f300-ae3e-968abb55dded: the JSON object must be str, bytes or bytearray, not NoneType
Progress: 7/20 (35.0%) | Success: 0 | Failed: 7 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: 02025-07-08 04:39:47,509 - incremental_crawl_and_load - ERROR - error:151 - Error processing https://www.healthdirect.gov.au/australian-health-services/healthcare-service/edensor-park-2176-nsw/penna-s-pharmacy-edensor-park/influenza-flu-vaccine/2a1af7ef-6d62-4870-a753-e090ce454ec2: the JSON object must be str, bytes or bytearray, not NoneType
Progress: 10/20 (50.0%) | Success: 0 | Failed: 10 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: Progress: 11/20 (55.0%) | Success: 0 | Failed: 11 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: Progress: 12/20 (60.0%) | Success: 0 | Failed: 12 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: 02025-07-08 04:39:52,179 - incremental_crawl_and_load - ERROR - error:151 - Error processing https://www.healthdirect.gov.au/australian-health-services/healthcare-service/edensor-park-2176-nsw/grace-dental-group-edensor-park/dentists/b31d8c63-5294-439b-b190-e766bb15cd10: the JSON object must be str, bytes or bytearray, not NoneType
Progress: 13/20 (65.0%) | Success: 0 | Failed: 13 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: Progress: 14/20 (70.0%) | Success: 0 | Failed: 14 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: Progress: 15/20 (75.0%) | Success: 0 | Failed: 15 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: 02025-07-08 04:39:54,627 - incremental_crawl_and_load - ERROR - error:151 - Error processing https://www.healthdirect.gov.au/australian-health-services/healthcare-service/edensor-park-2176-nsw/hearing-australia-edensor-park/hearing-clinic/697a6429-821e-e3a0-acb3-91158c79d029: the JSON object must be str, bytes or bytearray, not NoneType
Progress: 16/20 (80.0%) | Success: 0 | Failed: 16 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: 02025-07-08 04:39:55,861 - incremental_crawl_and_load - ERROR - error:151 - Error processing https://www.healthdirect.gov.au/australian-health-services/healthcare-service/cecil-hills-2171-nsw/cecil-hills-medical-centre/influenza-flu-vaccine/8ba68c70-3da8-4ea7-83e8-8ef7bcd296a7: the JSON object must be str, bytes or bytearray, not NoneType
Progress: 17/20 (85.0%) | Success: 0 | Failed: 17 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: 02025-07-08 04:39:56,758 - incremental_crawl_and_load - ERROR - error:151 - Error processing https://www.healthdirect.gov.au/australian-health-services/healthcare-service/cecil-hills-2171-nsw/cecil-hills-medical-centre/dentists/0f57b11e-9f05-e0a4-ce60-0a3ac397dc3a: the JSON object must be str, bytes or bytearray, not NoneType
Progress: 18/20 (90.0%) | Success: 0 | Failed: 18 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: 02025-07-08 04:39:58,144 - incremental_crawl_and_load - ERROR - error:151 - Error processing https://www.healthdirect.gov.au/australian-health-services/healthcare-service/cecil-hills-2171-nsw/cecil-hills-medical-centre/gp-general-practice/a53e2990-fb53-00e2-4c93-73d4610292fa: the JSON object must be str, bytes or bytearray, not NoneType
Progress: 19/20 (95.0%) | Success: 0 | Failed: 19 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: 02025-07-08 04:39:59,252 - incremental_crawl_and_load - ERROR - error:151 - Error processing https://www.healthdirect.gov.au/australian-health-services/healthcare-service/edensor-park-2176-nsw/myhealth-edensor-park/dietetics/ea1914e9-d060-e47d-3467-abc9ff117aea: the JSON object must be str, bytes or bytearray, not NoneType
Progress: 20/20 (100.0%) | Success: 0 | Failed: 20 | Already crawled: 0 | JSON: 0.0KB | Schemas: 0 | Docs uploaded: 0
root@e6a31d09111c:/workspaces/NLWeb/code#

you will see in the very first URL that it looked in:

https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea

It definitely has valid json-ld. It is using the "@graph" as they have several objects in each page. I beleive that maybe it is hte @graph that might be throwing it off.

json-ld in the URL above.

{"@context":"https://schema.org","@graph":[{"@type":"MedicalOrganization","location":{"@type":"Place","address":{"@type":"PostalAddress","streetAddress":"1 Prairie Vale Road","addressLocality":"BOSSLEY PARK","addressRegion":"NSW","postalCode":"2176","addressCountry":"AUS"}},"medicalSpecialty":[{"@type":"MedicalSpecialty","name":"Drug and alcohol counselling"}],"name":"Fairfield Hospital Drug Health Operations Enhanced Care Cads","url":"https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea","@id":"https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea","ContactPoint":[{"@type":"ContactPoint","telephone":"02 9616 8586","contactType":"work"}],"additionalProperty":[{"@type":"PropertyValue","name":"Mixed Billing","value":true}]},{"@type":"Place","@id":"https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea","openingHoursSpecification":[{"@type":"OpeningHoursSpecification","dayOfWeek":"monday","opens":"08:30:00","closes":"17:00:00"},{"@type":"OpeningHoursSpecification","dayOfWeek":"tuesday","opens":"08:30:00","closes":"17:00:00"},{"@type":"OpeningHoursSpecification","dayOfWeek":"wednesday","opens":"08:30:00","closes":"17:00:00"},{"@type":"OpeningHoursSpecification","dayOfWeek":"thursday","opens":"08:30:00","closes":"17:00:00"},{"@type":"OpeningHoursSpecification","dayOfWeek":"friday","opens":"08:30:00","closes":"17:00:00"}]}]}

[genericrobot77]

further info:

When i write a script to crawl the json-ld (@graph) and save to a jsonl file and then ingest using the data load tool, the documents are loaded to the db however it is not recognising that the Place type in the object is part of the MedicalOrganization Type and so returns it as a separate item. I assumed that it might link the objects in the graph using the id.

SO when the jsonl file is formatted like this:

https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea {"@context": "https://schema.org/docs/jsonldcontext.jsonld", "@graph": [{"@type": "MedicalOrganization", "location": {"@type": "Place", "address": {"@type": "PostalAddress", "streetAddress": "1 Prairie Vale Road", "addressLocality": "BOSSLEY PARK", "addressRegion": "NSW", "postalCode": "2176", "addressCountry": "AUS"}}, "medicalSpecialty": [{"@type": "MedicalSpecialty", "name": "Drug and alcohol counselling"}], "name": "Fairfield Hospital Drug Health Operations Enhanced Care Cads", "url": "https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea", "@id": "https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea", "ContactPoint": [{"@type": "ContactPoint", "telephone": "02 9616 8586", "contactType": "work"}], "additionalProperty": [{"@type": "PropertyValue", "name": "Mixed Billing", "value": true}]}, {"@type": "Place", "@id": "https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea", "openingHoursSpecification": [{"@type": "OpeningHoursSpecification", "dayOfWeek": "monday", "opens": "08:30:00", "closes": "17:00:00"}, {"@type": "OpeningHoursSpecification", "dayOfWeek": "tuesday", "opens": "08:30:00", "closes": "17:00:00"}, {"@type": "OpeningHoursSpecification", "dayOfWeek": "wednesday", "opens": "08:30:00", "closes": "17:00:00"}, {"@type": "OpeningHoursSpecification", "dayOfWeek": "thursday", "opens": "08:30:00", "closes": "17:00:00"}, {"@type": "OpeningHoursSpecification", "dayOfWeek": "friday", "opens": "08:30:00", "closes": "17:00:00"}]}], "_source": "https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea"}

it does index it but treating the nested graph objects as separate items so there are duplicate and confusing results.

when i format the jsonl like this:

{"@context": "https://schema.org/docs/jsonldcontext.jsonld", "@graph": [{"@type": "MedicalOrganization", "location": {"@type": "Place", "address": {"@type": "PostalAddress", "streetAddress": "1 Prairie Vale Road", "addressLocality": "BOSSLEY PARK", "addressRegion": "NSW", "postalCode": "2176", "addressCountry": "AUS"}}, "medicalSpecialty": [{"@type": "MedicalSpecialty", "name": "Drug and alcohol counselling"}], "name": "Fairfield Hospital Drug Health Operations Enhanced Care Cads", "url": "https://www.stg.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea", "@id": "https://www.stg.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea", "ContactPoint": [{"@type": "ContactPoint", "telephone": "02 9616 8586", "contactType": "work"}], "additionalProperty": [{"@type": "PropertyValue", "name": "Mixed Billing", "value": true}]}, {"@type": "Place", "@id": "https://www.stg.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea", "openingHoursSpecification": [{"@type": "OpeningHoursSpecification", "dayOfWeek": "monday", "opens": "08:30:00", "closes": "17:00:00"}, {"@type": "OpeningHoursSpecification", "dayOfWeek": "tuesday", "opens": "08:30:00", "closes": "17:00:00"}, {"@type": "OpeningHoursSpecification", "dayOfWeek": "wednesday", "opens": "08:30:00", "closes": "17:00:00"}, {"@type": "OpeningHoursSpecification", "dayOfWeek": "thursday", "opens": "08:30:00", "closes": "17:00:00"}, {"@type": "OpeningHoursSpecification", "dayOfWeek": "friday", "opens": "08:30:00", "closes": "17:00:00"}]}], "_source": "https://www.stg.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea"}

I get this error when using the db_load tool:

root@e6a31d09111c:/workspaces/NLWeb/code# python -m tools.db_load 4-items.jsonl Service-Finder Detected file type: json, contains embeddings: No Computing embeddings for file... Loading data from 4-items.jsonl (resolved to 4-items.jsonl) for site Service-Finder using database endpoint 'qdrant_local' Detected file type: json Using embedding provider: openai, model: text-embedding-3-small Found 4 lines in the file Detected JSON-only format. URLs will be extracted from within the JSON data. No documents were extracted from the file. root@e6a31d09111c:/workspaces/NLWeb/code#

[rvguha]

This is something we hope to do ...

…

On Wed, Jul 9, 2025 at 9:47 PM genericrobot77 ***@***.***> wrote: *genericrobot77* left a comment (nlweb-ai/NLWeb#257) <#257 (comment)> further info: When i write a script to crawl the json-ld ***@***.*** <https://github.com/graph>) and save to a jsonl file and then ingest using the data load tool, the documents are loaded to the db however it is not recognising that the Place type in the object is part of the MedicalOrganization Type and so returns it as a separate item. I assumed that it might link the objects in the graph using the id. SO when the jsonl file is formatted like this: https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea ***@***.***": "https://schema.org/docs/jsonldcontext.jsonld", ***@***.***": ***@***.***": "MedicalOrganization", "location": ***@***.***": "Place", "address": ***@***.***": "PostalAddress", "streetAddress": "1 Prairie Vale Road", "addressLocality": "BOSSLEY PARK", "addressRegion": "NSW", "postalCode": "2176", "addressCountry": "AUS"}}, "medicalSpecialty": ***@***.***": "MedicalSpecialty", "name": "Drug and alcohol counselling"}], "name": "Fairfield Hospital Drug Health Operations Enhanced Care Cads", "url": " https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea", ***@***.***": " https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea", "ContactPoint": ***@***.***": "ContactPoint", "telephone": "02 9616 8586", "contactType": "work"}], "additionalProperty": ***@***.***": "PropertyValue", "name": "Mixed Billing", "value": true}]}, ***@***.***": "Place", ***@***.***": " https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea", "openingHoursSpecification": ***@***.***": "OpeningHoursSpecification", "dayOfWeek": "monday", "opens": "08:30:00", "closes": "17:00:00"}, ***@***.***": "OpeningHoursSpecification", "dayOfWeek": "tuesday", "opens": "08:30:00", "closes": "17:00:00"}, ***@***.***": "OpeningHoursSpecification", "dayOfWeek": "wednesday", "opens": "08:30:00", "closes": "17:00:00"}, ***@***.***": "OpeningHoursSpecification", "dayOfWeek": "thursday", "opens": "08:30:00", "closes": "17:00:00"}, ***@***.***": "OpeningHoursSpecification", "dayOfWeek": "friday", "opens": "08:30:00", "closes": "17:00:00"}]}], "_source": " https://www.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea"} it does index it but treating the nested graph objects as separate items so there are duplicate and confusing results. when i format the jsonl like this: ***@***.***": "https://schema.org/docs/jsonldcontext.jsonld", ***@***.***": ***@***.***": "MedicalOrganization", "location": ***@***.***": "Place", "address": ***@***.***": "PostalAddress", "streetAddress": "1 Prairie Vale Road", "addressLocality": "BOSSLEY PARK", "addressRegion": "NSW", "postalCode": "2176", "addressCountry": "AUS"}}, "medicalSpecialty": ***@***.***": "MedicalSpecialty", "name": "Drug and alcohol counselling"}], "name": "Fairfield Hospital Drug Health Operations Enhanced Care Cads", "url": " https://www.stg.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea", ***@***.***": " https://www.stg.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea", "ContactPoint": ***@***.***": "ContactPoint", "telephone": "02 9616 8586", "contactType": "work"}], "additionalProperty": ***@***.***": "PropertyValue", "name": "Mixed Billing", "value": true}]}, ***@***.***": "Place", ***@***.***": " https://www.stg.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea", "openingHoursSpecification": ***@***.***": "OpeningHoursSpecification", "dayOfWeek": "monday", "opens": "08:30:00", "closes": "17:00:00"}, ***@***.***": "OpeningHoursSpecification", "dayOfWeek": "tuesday", "opens": "08:30:00", "closes": "17:00:00"}, ***@***.***": "OpeningHoursSpecification", "dayOfWeek": "wednesday", "opens": "08:30:00", "closes": "17:00:00"}, ***@***.***": "OpeningHoursSpecification", "dayOfWeek": "thursday", "opens": "08:30:00", "closes": "17:00:00"}, ***@***.***": "OpeningHoursSpecification", "dayOfWeek": "friday", "opens": "08:30:00", "closes": "17:00:00"}]}], "_source": " https://www.stg.healthdirect.gov.au/australian-health-services/healthcare-service/prairiewood-2176-nsw/fairfield-hospital-drug-health-operations-enhanced-care-cads/drug-and-alcohol-counselling/ff106b48-363d-2098-7bac-1fba437e67ea "} I get this error when using the db_load tool: ***@***.***:/workspaces/NLWeb/code# python -m tools.db_load 4-items.jsonl Service-Finder Detected file type: json, contains embeddings: No Computing embeddings for file... Loading data from 4-items.jsonl (resolved to 4-items.jsonl) for site Service-Finder using database endpoint 'qdrant_local' Detected file type: json Using embedding provider: openai, model: text-embedding-3-small Found 4 lines in the file Detected JSON-only format. URLs will be extracted from within the JSON data. No documents were extracted from the file. ***@***.***:/workspaces/NLWeb/code# — Reply to this email directly, view it on GitHub <#257 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABICKCUJVTKYOSOWYPJUWD33HXV6ZAVCNFSM6AAAAACAYLAFOOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTANJVGQ3DMMZVG4> . You are receiving this because you were mentioned.Message ID: ***@***.***>