Duplicate "Article" objects are created in Readwise (affects PDF only?) about omnivore HOT 5 OPEN

Update: I made one additional highlight in the PDF and waited about an hour. I now have five instances of the article created within Readwise with two highlights, and one additional instance created within Readwise with three.

from omnivore.

@justinsteven does readwise give you a URL for those PDFs?

from omnivore.

@jacksonh I re-added the same PDF (but forgot to rename it to something sensible in Omnivore), highlighted it, and allowed a few instances of it to be created in Readwise.

Based on this I can't see how the following differ in any way on the Readwise end:

1. A PDF in Omnivore, with highlights, synced to Readwise (https://www.rfc-editor.org/rfc/pdfrfc/rfc5321.txt.pdf)
2. A HTML article in Omnivore, with highlights, synced to Readwise (https://www.whatbitcoindid.com/podcast/whitfield-diffie-on-the-history-of-cryptography?format=amp)

e.g. Readwise says:

https://readwise.io/api/books/?category=all says:

// SNIP

{
	"3": {
		"id": REDACTED,
		"book_data_id": REDACTED,
		"amazon_id": null,
		"title": "Enscript Output",
		"author": "RFC Editor",
		"readable_title": "Enscript Output",
		"resurface_weighting": 1,
		"cover_image_url": "https://readwise-assets.s3.amazonaws.com/static/images/REDACTED.png",
		"small_image_url": "https://readwise-assets.s3.amazonaws.com/static/images/REDACTED.png",
		"num_highlights": 1,
		"last_highlight_at": 1707287669,
		"is_article": false,
		"book_type": "omnivore",
		"filter_include": true,
		"category": "articles",
		"book_tags": [],
		"source_syncs_all_books_together": false
	}
}

{
	"4": {
		"id": REDACTED,
		"book_data_id": REDACTED,
		"amazon_id": null,
		"title": "Whitfield Diffie on the History of Cryptography",
		"author": "Peter McCormack",
		"readable_title": "Whitfield Diffie on the History of Cryptography",
		"resurface_weighting": 1,
		"cover_image_url": "https://proxy-prod.omnivore-image-cache.app/REDACTED",
		"small_image_url": "https://proxy-prod.omnivore-image-cache.app/REDACTED",
		"num_highlights": 1,
		"last_highlight_at": 1707220426,
		"is_article": false,
		"book_type": "omnivore",
		"filter_include": true,
		"category": "articles",
		"book_tags": [],
		"source_syncs_all_books_together": false
	}
}

// SNIP

from omnivore.

Ah so I guess for PDFs readwise doesn't have a URL to deduplicate with. That means we will probably have to maintain some state from them to keep those IDs

from omnivore.

Maybe related : when highlighting PDF the highlight appears in yellow, and I noticed that often (after changing pages ? after reloading ? i don't know!) I noticed that the highlight was a darker shade of yellow. It's actually because there are duplicate highlights created on top of it (confirmed by deleting the highlight and seeing the color get lighter and lighter ; also confirmed by adding a note to the first highlight and seeing that I can only access if later if I delete the "above" layers of duplicates). All of this is on the android version 0.0.188

from omnivore.