> ## Continuous-process anchor
>
> This spec describes an instance of one of the retired-script themes
> documented in docs/design/retired_scripts_patterns.md. Before
> implementing, read:
>
> 1. The "Design principles for continuous processes" section of that
> atlas — every principle is load-bearing. In particular:
> - LLMs for semantic judgment; rules for syntactic validation.
> - Gap-predicate driven, not calendar-driven.
> - Idempotent + version-stamped + observable.
> - No hardcoded entity lists, keyword lists, or canonical-name tables.
> - Three surfaces: FastAPI + orchestra + MCP.
> - Progressive improvement via outcome-feedback loop.
> 2. The theme entry in the atlas matching this task's capability:
> F1 (pick the closest from Atlas A1–A7, Agora AG1–AG5,
> Exchange EX1–EX4, Forge F1–F2, Senate S1–S8, Cross-cutting X1–X2).
> 3. If the theme is not yet rebuilt as a continuous process, follow
> docs/planning/specs/rebuild_theme_template_spec.md to scaffold it
> BEFORE doing the per-instance work.
>
> **Specific scripts named below in this spec are retired and must not
> be rebuilt as one-offs.** Implement (or extend) the corresponding
> continuous process instead.
Continuously reduce the backlog of papers missing abstracts or core PubMed metadata in the SciDEX papers table. This recurring task runs every 6 hours to fetch missing metadata (abstract, title, journal, year, authors, DOI, MeSH terms) from PubMed's efetch API, prioritizing papers that are most useful to hypotheses, wiki citations, and debate evidence.
scripts/enrich_papers_pubmed_backlog.py — Core enrichment script with retry logicNone
scripts/enrich_papers_pubmed_backlog.py with improved retry logic for database locksORDER BY created_at ASC to ORDER BY RANDOM() to prioritize papers that actually have abstracts in PubMed (oldest papers are often case reports/letters without abstracts)synthetic_27, synthetic_17)
scripts/enrich_papers_pubmed_backlog.py with batch PubMed efetch (XML parsing, 500 PMIDs/batch, 0.4s rate-limit){
"requirements": {
"analysis": 6,
"reasoning": 6,
"safety": 9
},
"completion_shas": [
"197f9a8f0bcc06b10fa32850ee4a07f635be96f3"
],
"completion_shas_checked_at": "2026-04-13T00:16:23.686188+00:00",
"completion_shas_missing": [
"4b3192a7ed6d1cb75dcca6841e0a1b650b1ab4ef",
"d70754451ef637082305a3fef2dc70347198ef6a",
"c6bfd9a0f68cea171c74f7d8ec784a139ba35bb6",
"e1e5845068aed7b864d554b3aeb56d1fe8c74e5b",
"ca2b199490ec74ad271dbc679f15460ba079673b",
"8fe8c49b290025b32120d1d3bc37aa32b6345af3",
"3c9dfa675347c3063c885e379de392a22946f575",
"96888510f1fcd40d421ca7b0ea309011f31f5ffd",
"1bb6570e2b0ddc6ec3907f0068e830c67329e38d",
"a6514ad567aaece25fac7b9b7514af3306c34236",
"3fb5b26b49f824cdf6a1f33150a5fcb752d54f13",
"090aae6a78f2dcf2bbd2cb94f43f03cb39198777",
"96020d567c6fda3fd323013b2306f6d34801890f",
"c2860741ca77689e0f76347bb0bb578daae40ce8",
"c9fe958e6d1557e001d30e78d4babe7a98064542",
"d19e6a0685806f1aa514085668e0e9bf26a91cdb",
"573989561ddedcdffa0d0fa7c2825adffd3170a8",
"4aeb220d073ecde043fff339b155bcb297b3730f",
"992e6dbca38821e3f10e4b4eabe90c14af408a16",
"a844718d386e0065575abc47889a590dbca21cd2",
"6684dcfce61bef8c75b143c826ef1c062284f83b",
"f5565a723397ae689d7f377d05bae97d5d21b104",
"f7adc5a5b92c8fdcec629457d8f0480760e2ddb2",
"7d2ae8d6e6def4f99be2754f91acd8797cdb0183",
"fa1a00cc94bc7bfab8abbbd7267f8ee4b25c2d7b",
"e903afd8f731fe755d4cffd00ec83df00a3e0e29",
"1a9b23dc663f02be9a814d349379fb050cc33493",
"89b78ac13a3d49717e753e0594be4f2c50bd081a",
"b471b849edf6906b7ee408d5d0e95321ec92e675",
"29ef0b1fded4f1b6a95044fb60e4fe5414f193e1",
"9726694a3e0dcd14b5654b4a32d25f024c08ec18",
"fb9627a40edb4b609a7b05e622621581eb0eca31",
"94265a5b77c21b9f064fed9b931062796e24e1b0",
"ebd2dad83756632868343ffdfcec7c56f9cea093",
"4fa5c1a8326bdb1ef08b635f0ca9e742cb4c11e4",
"08ac8fef4c580482c39c7e959b5cf0d22f3b393e",
"b08a4ec3fcda2cae803d9d53dfd0dd360d523910",
"efe8ffb898f28e64e8270f348c85ccab7c4f4e2c",
"0b83b25d61fb5d16d1939fd0dc249694f5e8f984",
"cdbf18e5f13cd14cb04f6668c35cdcdb12cc830b",
"d9f9282803836a5e1d7b21759e0be3f2caae5115",
"3cff5d587c00d452a5903f2b1314a290d3f12d89",
"8d3906e704d85ba86bf70065be8c59ad09e2830d",
"46aad7bb0b0eeb22a523a003b4527724abbab8c8",
"3386f34f29bc96c9c5e53855ff89247862db5c4e",
"87bedd0e3740b85128054e69f2eb54229c471b15",
"1231eaceb7f1a3b949f45f55ef79d1e9f611d578",
"26cd5b4656fd1639ce0815fb9a5b499678b505be",
"6955776a4475bad7a068cfe28c38c5d4ffa0639b",
"c1f0d829365943b809a98c0cd72156f81a2e0f22",
"ee3be3b57982c730a9ce199fa65df476134d34c5",
"992d6eeb614238a188f21955c6948e6f5a36af53",
"6ac60bb56221dc7f8845d740ef62c53be24f262c",
"c560e8d15ebed14743dfbf3ec723c738cfcd9be0",
"e665bf7d887d1d7eec033d57f24ba573b08493f9",
"ec0ebea534e9f8e842f92af6147f254108eee991",
"2230cf70fdb66129c2d9ff0f3260a943988e6f3d",
"1e14965da8e8f7e9db220d1cea818d0357cae908",
"1b7042de0ed3ac728d451ccafe907b1308b92a75",
"53e29b1f7d45e29db5aa51eb75e877eae651f493",
"2d94bd3e9a58b728d8e35b7e0f5ec1b4b2d9cd5c",
"1d07815c8bd39597395458c400ffdb760c2c1df9",
"48c488abd3d538daaf0e7c8f05e2bcb04cfaa5e5",
"29875d927bf6c319e8853f82a3d8f901f605ed04",
"095536cde4492d7e30fefbf1a938a6a5d84e3db0",
"4866650b9b3a2b39944a09be6887211fc7ec7e65",
"d2f819a68329f9e3467afc3a4446e2bb3a9f0d30",
"d1c76f138f59a13926fb959826fd4ae14fb20e7e",
"b188583d0cccc8695217b3568c891664023f4735",
"2f729c0768724c109b63ff6f327d1d19430cc8b3",
"56ceea514c6e1d4a45328f47961065d617848eb7",
"b521a94e28c6d993a5ad69cfbc9fac7c1382384c",
"f963b41cb61e7194cf0f745836ef7d2c1ee9a0c8",
"0367880a29410c6b1180808f767adcbb954a72e9",
"7555b5e0711908e3250343e95dc3d086fcda991c",
"66ddcdf9f82912aac4534e0bbc8b1ccceeefd18a",
"2411c06af0f4d838579a65bf60b1bc5a6f8baa8c",
"eae760cce89299d85158f690c96b5b27f3c9dbbd",
"912df645a39f1187731db0758674d21ba02aa752",
"c2646e24a7eee8a900d31ee297e99618be905de8",
"95ae923c31373e75b2b39025ce1281de817083fc",
"2db99874cc3d39931879ee364749f180a965a7a5",
"107ff17680f048276c37151c7dfc18cd363ec234",
"ac143f757e73ceb7c875497061bdd89c8deb6b98",
"b1bc5ad369cad359e6942e1084de3e3dfd36f28b",
"322f4b8484c1a9b1717d8a77d0c2266ae1da545c",
"e68ee4e8616a1ae3335bba91399cb91f1ddbf684",
"26ec3a2852a3f80bd43b28b499cc56e89c8ec4e0",
"4d5371b07b5a9c160a642ebf5a2749e193d6f5fc",
"b9015acf922788fb0adc025170f8eaeaf552eeb2",
"7ed10f09b6c61a1374b38d951c4fc2f9f4f91f5c",
"4e7036a84f305e369ff7e243175859e89d6bbb2b",
"cb2f382375a87793785e6c7ca3b80f427e0e9859",
"300bbe6cf34ed20daf4a2a4a4863460da42772ea",
"0c8c1a6fa1a92e182ce10606e0d42d65ef252a41",
"e913eb516b54943a537f5c657eaff78114ad5f69",
"2658035bd87cc21a049b8b676ae88ba71f938620",
"27ffd7aecb22a1ee968c031c1b3517b9be439aa3",
"65eeaaf6455deac7709888ff9809c88e80c28743",
"45892f75fd0171a681da10b225e1c0c014ef61c0",
"5309c2cb1468079e02dd8802bdd8d962381aeee0",
"d684698db0c901c82d6ed9f9618bca2fc1edfeb5",
"0f8f02b1049f134226c3474ff4ca0189b418255a",
"29b864a2ebb849130c4d6e31e845a075ac31799d",
"858b09bf52dc88cfc7dcc9656d3fa3bb2a34ba7f",
"3e3970b3cd386ac9676e0d191b8e8f3c864d28a4",
"f42ffbcbede49a29224caf92fd981a3508160892",
"6cbe687ba36568cbc989f58594885d7833d48456",
"dea5f758489ed36e7eb4b11d8a7350c6fb28b612",
"11f2f095c3142249a7198ff63d58b84d0b07dc38",
"ea9835907f430c19c868eb32d431bd798f75f6ed",
"2b24b56dd0d9f3d12b3a8ab9aad428028a10947d",
"09315bf70dfb9f4f762fedf8fd6b41785a352a8b",
"41fbf3a15c91c40018205c3616aee3afd57304ad",
"c32229445676a4abdbf6141ac8fcfaeb17cbe280",
"ba3c7fe124eb9ffca831fbfb2e497b3d8cfc95ff",
"a421dfd0b78298b1611b3d76df12274cf6149e19",
"cd11bd9fd21e262a90cb1d0099777db7cd4c715f",
"a2e9eed05abf3a3e7595e313b744aac18172bb47",
"529c3f47edbd588049b3a9f8bbdee534ecc631f7",
"e5eab8e053949996167cc9a115896329a5354b9f",
"56927885e849d49dedef910f8f0af3fd2eebce59",
"23f83c54ebfdffaf4c7621d4160f0901924507a0",
"2c4f0f2f985f6de589fb1b70ed940f14889fff7a",
"38407066394d6680e092594067dca61ff6110867",
"262ebdfc99ea617d0d7f2d62854252643dd7181f",
"eabbd08c9e0a15c23d206c1758cfbb0814f02e5f",
"bf39b52406d316c06b8bfb037ce38a1e1012bd7b",
"5b827b61cc1d15bd157ffcdf1d17c7a4000e3d13",
"9f2d8de9138f492065ef97215c54766a41f11a36",
"66929ea929196de702ac27ce9433aa5bafd3f8ad",
"c00046eca2116dbc919e4589ca7520d5326f9027",
"3c48200cd5aa78b05996e001d3684c7c060c5e5c",
"15d28a8d06e9db25ca3436f94ed5a00160e108d6",
"c18ded818c4d7d7397f76c2f588391d84e970737",
"e16b7642e874eab0d2e72f1b9f8b112a41e2009c",
"a69499fcefec3683c4134f0f4ca0ee62efd42812",
"2ced8b3018c84ec28be12d3ba292d5062fec446d",
"bc2e92ff47e8b89465593254a0176c22015ffedc",
"10e03dd7ce39744b120abfa54ed1d59edfb116a0",
"91eb6b3413c1c54f30f467150cc6baaba8d516ff",
"62cad235b1f3cda3a7152b454eb3ff53d8c01451",
"517b91f927219a2dd48c19a8feda1efd5ea8543f",
"ffd14244bd3e608186e446042f60cc433bf42f08",
"926616dd202855a91e9448b3f99a2ec26bfdfaa1",
"d7b149ea259f9216ca09587e1998f0759a51fac1",
"66430b36d95bbfdeaecdff94898ad018c19fce07",
"65a2da4007a9a5fdd66c36c9337d350eda23665b",
"ae46514f80ebb68500e1c0727cd29660bb1f97d8",
"c21ce1fa2d7e189b80ebe85e45698164a4452137",
"80fa7ca2996604eff9412f8057a008f6ab9de36a",
"860d23ffbe8fbde1c409a5ea029c7cffe445d6c5",
"82f128b7834a97d5bbb4958c3134e70d82abad01",
"6795be0edad1967866d0ef1c55e2dc528a5e7b47",
"8c8f26d8c62726cd9f1ce2d8203bef89572ea9a8",
"5436b750eec66d00f533ac776d891c9b7d1d804a",
"ef7c819b6f0d3e72da0492b587bd7f0ccba824f6",
"06e668b7049156de4d28e3b4214bbaccfb1a1a48",
"2f88b9ada54f253009a466f0218fd1ca96a9f9ee",
"bb24907321e087643dd9ee2071dddb39b44276f1",
"fad327429dcf191428c47f910d5b811043e117b5",
"6ce4a87d5b9c28e1aa00475ab782039585138795",
"94ee4a2e5e4c1bebf282de3cb4a151bc2ac45b75",
"62b047a3a8c5526338b10a31fe836dec542d3e5f",
"37d2593140bafd81105c2702620d49e6b3735cb1",
"bac22fd67832d1c6dd82d288b618a8a871503c18",
"4f7406afee5c6a4f0dba5596d1135e45b39647d8",
"a4e7b0e1647f291db4ba4f325c2a67189ba4f6ca",
"c97f91cb24e2987ea038e0e9a08a8f9a120ecdb9",
"8391a4b7258225bdc38940778e100978497091e5",
"5a67a8d4981dbe904ace315f46391f00c902c735",
"4f05a029f5ee3a48ec3c41481565d18fa0bd6ef1",
"899e8babefd742c1847413d0520963b34a7b31dd",
"b28a38177933c9a8086b72118cee633ee254468f",
"5b63a7818ee6d25b6d314450f94cb2e5138c08df",
"c09803386b0c1459798ffd77ba64e546d7aca222",
"9cfc86038b6ac1512e5516d3b84b4e1a22a86425",
"a8028e5fcd2de83133b51a13b8a80d19e259f22a",
"e5a6eb45e76edf2df167aa7241117fcfca039272",
"870ed25f603b00bbb9a2b389e3233e50eaf16f33",
"8ea47f1310de60c20c6964dee577f5fcd14ad8bf",
"8c589c83470deedf5bef666c1fc6294aca4ffe5a",
"641762f00cefa80c4cf6c3ee3d95d3fb305b2b37",
"9308b21e29014ce6bcc378aae5bbd68ef2adbefa",
"d991ce7f34f94ca68b56e076246492076e01c50d",
"5e56e10453d1ae6cca12bb5ca9a2c1cd347cd0be",
"2dd3f0883d521cb224d0138f6f3c37e4e74a2e10",
"9ae22ef16a4dd737db8618bc13ba52b31733e098",
"3e295a0c2903268d26feb83838cd900257bb2ad3",
"0a85446637a3a7b587cfaa01e6d3747c7ef17646",
"488cece73025d5aec6e8ea5651796e9f1fc8d05f",
"901c7534d94555900ceaea1ebed29242905bffbb",
"10db2b5c69fb7cd63d30f540bdd905ff9a4287c6",
"4f259f2793d1aac41ca6ce519259fab1ef935fc7",
"1605bd2258691897de9e8ecf4a6e4bc1e78ed956",
"cdd54c5c5e16543c11ee48038143007ecdec6062",
"1647fa7df715cb19977a5023812abbec32051616",
"5fd257b2a235e8942cf7c757b41ee6e1ea616da0",
"76836603d0c486bfb1f26e65edb859d38ce71298",
"d5d369f4aa9fac237b88e30c39b7835cc9305507",
"1643a8b1b5a35b3a040de4ef6becb1bf74d2c521",
"f1e051e27a8beef8cdcd409b0abc7bec6f254681",
"578c9e2f9763722f2adfad80f2e1c18d514c3d11",
"0c9946681712511d9c3e7f265e0b9d5b53abb169",
"8b3def9bc0d5e755daaab8ecc6c8cb03b1511c91",
"1658b8002d45f24e533bd6956663662c110ac46c",
"70c83f55e00497c48a347a0460bfd68089c132df",
"7d2b9aaae757f79134ace8a3c20f6e643bda49c6",
"11d5916a46a76be353de1a83f1e0f355587e7cc0",
"9cc9f5fecac4a86c26983f087fb3c03bd6a6c37e",
"98ce130bfc014ecd1636f5f2de6e3e9451d3e102",
"78f3fb8667a2a6995ab6fe3a9ae563da0d6fa360",
"390902e9c34bd18340870ae43aed0d962e4fd7d6",
"faac00e40b25409c71acac771715f7ae39eb919e",
"9754768abf92b92f9d5ffc3aa17763ac8ba13998",
"9b4557320cd5912220eac166e5120efaa5b7da1f",
"cb0cc059608603784641f3e3a7ce1c9ca8df5afe",
"76a5619cd0b44160d53e269582d44b789bc83c02",
"32cf414bb1deb625d19132bee1a84fdd6f9f360c",
"09d0f1e00ba5ca4810a9a787fd614ed1a1bb062b",
"92686f8b7acc136afa4ad36916ba3b29e85e25fa",
"7993d8205576def3351c24b376e22930c4d58751",
"0bb90dfdfb74bd7b277c833d2220be68dfd60a6e",
"9161ca609c385d7c77ce85ee8b62664173ede53d",
"866fb2b4a1018b9fd831faa27f13d5231d064cae",
"a3803c548cfc12a26643d37924efb5408377e342",
"f80f245082f0adcb0ccd64da47f4d27e1f348138",
"28e8f4b8722432c3505640f6cbbd90544da60ec5",
"98c3f5ffbe380173595e84f67d16ffc5b9474a33",
"4cb0167f86fc3661a30179357ecd1a3d9b5049a7",
"0ede056b946e60b010f74ba76a58d361bc83a318",
"19d17dc3cf87357c6acbad5e943a90f96f875b6b",
"d666938c759c2a5ebfb87e70b764b2ee9b427514",
"7202c3346c92b97d3515aeffe617e107dce80e5a",
"95e66be8f1cef50536e5f32eb10d44b982d5c93d",
"85d1da3734a6d41dd2e7fdac0394cc7f57bcaddc",
"5f4e24d10fb83d7efc91f0b28bf1c6263e129935",
"4a42f8e6dad6989567789c6542bbe5322b6c4dcb",
"21af317e6fcb98208ab27eaf11e1e05652068b27",
"473f66121976d572d7fcd0001e5c3e9d557fe077",
"84c0e4a288e6f879aeccbf459a46c02e63458f18",
"cf5b77897d27e31c3afeeb3818de90292da54816",
"110224782cc5396ee687539eb27a77798cfa242d",
"3270d9e54f2d323b7cb24e1b38a062c165e37f60",
"5095b8601435b1bd46976bc0941f671df4e3434f",
"c2593f039e8a2a1ab1982ff798311c834967da7e",
"f4f04234313a02cd5399e8f33ffa2d5a5c8b5302",
"25d14209ecb8cc027a0d46c1a574f1e594099c0a",
"7cfa561fa1d02a209e048443c3bb78555c8b13af",
"8a00f4a1cde27b64f2f2ba6e5e1ce54812bf9457",
"3aedbec73c86b2bc8510ec13e303505db9521dc3",
"f7f69cda38e31497e7962d39fb5cc33c5dc58716",
"f34c44392982cd16edf7ef2dd6da9932868567d3",
"cc51c4469823eb33958481612d209636e8ac284f",
"56f5412925ec840f9db6869cde9d031627c32528",
"e8ff71c662ca9c128f2abb028a3dd78cc50f543a",
"af2fa1a40d75e36c1f333698a7328a64e0a02a0f",
"36f2d4bd54c54bc5efd4cde47a882eaf9a0390f5",
"c3681c040734ec676e6e51db375957465a2e8e75",
"1687f1b35cb50970481a54850bac18e66b1b9ebf",
"c9509c79c5dcbcbb988277008c5b1b3b73e7576a",
"e107aefe0e9dd9ea313009c9ac6faa22549a1939",
"5aed28ab27c7b03ecd0aaeb801cc90d28a65245c",
"cf7d276a96796c8a04c673c24227e80ad4bc8d7e",
"d34f65bcc702391712ae08abbb3f1a1c0cf45a53",
"e9f3718583502efa5905dc416a49200487c99d1f"
]
}