TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

First word discovered in unopened Herculaneum scroll by CS student

1122 pointsby razinover 1 year ago

30 comments

versteegenover 1 year ago
The lettering was found by looking for &#x27;crackle&#x27; texture on papyrus segments from the CT scans which obviously were in the shape of Greek letters, and annotating those as training data. Unfortunately such crackle texture isn&#x27;t visible, at least by eye, on most of the papyrus. Probably it&#x27;s only that visible where the ink was very thick. You can easily see the difference in texture in this electron microscope image [1] (far higher resolution than the CT scans) but especially on the very edge of the inked area (the narrow strip in the left image; I think the whole right image is inked) where the ink was pushed to. I&#x27;m surprised the crackle was discovered only after the Kaggle Ink Detection contest. Looking at the CT-scanned fragments with infrared ground truths, which were used in the Kaggle contest, Casey Handmer wrote [2]:<p>&gt; The ongoing apparent failure of deep-learning based ink detection based on the fragments indicated to me that direct inspection of the actual data would be more fruitful, as it has been here.<p>&gt; ...<p>&gt; I found similar “cracked mud” and “flake” textures corresponding to known character ink, but only for perhaps 10% of the known characters. It’s been a long day, I can probably find more on closer inspection, but that does make one wonder about automated ink detection and what that is seeing.<p>These new images are much better than I hoped for, but still only in one small area, so I&#x27;m still pessimistic about more than an odd sentence being readable.<p>[1] <a href="https:&#x2F;&#x2F;scrollprize.org&#x2F;img&#x2F;tutorials&#x2F;sem.png" rel="nofollow noreferrer">https:&#x2F;&#x2F;scrollprize.org&#x2F;img&#x2F;tutorials&#x2F;sem.png</a><p>[2] <a href="https:&#x2F;&#x2F;caseyhandmer.wordpress.com&#x2F;2023&#x2F;08&#x2F;05&#x2F;reading-ancient-scrolls&#x2F;" rel="nofollow noreferrer">https:&#x2F;&#x2F;caseyhandmer.wordpress.com&#x2F;2023&#x2F;08&#x2F;05&#x2F;reading-ancien...</a>
评论 #37865822 未加载
sillysaurusxover 1 year ago
See also Nat’s twitter announcement: <a href="https:&#x2F;&#x2F;twitter.com&#x2F;natfriedman&#x2F;status&#x2F;1712470683207532906" rel="nofollow noreferrer">https:&#x2F;&#x2F;twitter.com&#x2F;natfriedman&#x2F;status&#x2F;1712470683207532906</a><p>$700k is a life changing amount of money. I admit, it’s tempting to drop everything and go devote myself like a monk to the pursuit of ancient enlightenment via modern ML. I wonder where we’d start…<p>It’s also funny that the scroll might just be a laundry list.
评论 #37859369 未加载
评论 #37858509 未加载
评论 #37859601 未加载
评论 #37859913 未加载
评论 #37860096 未加载
评论 #37861944 未加载
评论 #37877066 未加载
评论 #37866915 未加载
评论 #37858961 未加载
评论 #37858512 未加载
评论 #37862886 未加载
dr_dshivover 1 year ago
I highly recommend getting into classical literature. It is incredible and beyond conception — I had a light scattering in my education, but only later and recently have I discovered how incredible it can be.<p>Suggested Reading for beginners:<p>* Life of Pythagoras, by Iamblichus<p>* The Golden Ass, by Apuleius of Numenia (specifically, translation by Robert Graves)<p>* Life of Alexander by Plutarch<p>* Education of Cyrus by Xenophon<p>* Parmenides by Plato<p>Also, I have found SHWEP.net to be invaluable for a gentle yet rigorous guide through many classics, though it takes an esoteric bent (which I love)
评论 #37868494 未加载
评论 #37867801 未加载
评论 #37870362 未加载
评论 #37867797 未加载
评论 #37868448 未加载
评论 #37869041 未加载
kelsey9876543over 1 year ago
I recently saw a wonderful youtube video on this: <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=Z_L1oN8y7Bs">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=Z_L1oN8y7Bs</a><p>Title: Herculaneum scrolls: A 20-year journey to read the unreadable<p>it goes a little bit into the technology of how this was done, deep learning finally cracked the code. They had the scans for a decade but it took ML training to be able to identify which parts were paper and which parts were the ink on top. This had been done on a different set of scrolls with easier to read higher contrasting materials like the video says, 20 years ago. Deep learning is cracking the code for these datasets we had previously thought were impossible to algorithmically solve.
评论 #37859712 未加载
评论 #37863240 未加载
评论 #37859257 未加载
jdminhbgover 1 year ago
This is the 21st-century equivalent of living through the opening of Tut&#x27;s tomb. Incredible to think there&#x27;s a very real chance that in the medium-term future you might be able to buy a copy of a newly-translated work on Amazon that hasn&#x27;t been read for millennia.
评论 #37859854 未加载
davidwover 1 year ago
That&#x27;s extremely cool. I wonder what we&#x27;ll learn.<p>As an aside, the &quot;Professor Seales and team scanning at the particle accelerator&quot; photo looks like it came from a TV show. &quot;If we keep telling the computer &#x27;enhance&#x27;, we&#x27;ll be able to read it&quot;.
userbinatorover 1 year ago
This might count as one of the most extreme stories of data recovery I&#x27;ve seen. I wonder if in another 2000 years we&#x27;ll have a &quot;first file discovered on discarded hard drive platter&quot;.
评论 #37864977 未加载
评论 #37865297 未加载
f0e4c2f7over 1 year ago
The first 30 minutes of this interview does a great job of explaining what&#x27;s going on here. Really interesting stuff.<p><a href="https:&#x2F;&#x2F;youtu.be&#x2F;qcvMjoJdck4?si=RL1WnAAj4loS1D2s" rel="nofollow noreferrer">https:&#x2F;&#x2F;youtu.be&#x2F;qcvMjoJdck4?si=RL1WnAAj4loS1D2s</a>
yieldcrvover 1 year ago
&gt; In early August, contestant Casey Handmer, an ex-JPL startup founder and polymath<p>interesting terminology, I&#x27;ve never been given accolades for being a multifaceted human being.<p>I&#x27;ve gotten &quot;generalist&quot; and &quot;after much consideration, we have decided not to proceed with your candidacy &quot;
评论 #37890010 未加载
tgsovlerkhgselover 1 year ago
<a href="https:&#x2F;&#x2F;scrollprize.org&#x2F;" rel="nofollow noreferrer">https:&#x2F;&#x2F;scrollprize.org&#x2F;</a> explains the original challenge&#x2F;issue: other research showed &quot;virtual unwrapping&quot; based on CT scans was possible, but these scrolls had ink not clearly visible on CT&#x2F;X-ray, so they had to go back to less visible structure (I&#x27;m not sure if it&#x27;s the structure of the paper that changes or actually the ink being visible but less).
elifover 1 year ago
I wonder how many AI massage iterations this is away from being able to completely copy arbitrary books without opening them, and if this technology will hasten the demise of paper texts.<p>If you can just stack 20 random books and within seconds have them be indexed and searchable digital ones, libraries as we know them will suffer perhaps the final blow in obsolescence.
natalisteover 1 year ago
I wrote this for a different community (filled with semiliterate sophists), but this is absolutely huge and could upend huge swathes of understanding about the last two thousand years.<p>You can avoid the longform essay below if you want. The short of it is there are several potentially common works possibly in the library that could directly prove or disprove what is found in the New Testament and the predicates of Rabbinic Judaism as established at the Council of Jamnia.<p>We could be seeing the beginning of conclusive proof that invalidates the narratives of Christianity, Judaism, and Islam by the end of the year.<p>The Vesuvius Challenge isn&#x27;t just an interesting contest in the machine learning realm; it&#x27;s a groundbreaking endeavor that could redefine our understanding of the humanities if successful. The opportunity to digitally unroll and read the Herculaneum Papyri could offer unprecedented insights into ancient civilizations and the total feedstock of civilization today. This is not merely about filling in some historical gaps; it’s about fundamentally altering how we understand antiquity and, by extension, our own intellectual heritage.<p>The loss of the Library of Alexandria has long been considered a &quot;dark age&quot; event for intellectual progress. Now, consider the Herculaneum library—a collection of papyri from a villa once owned by Julius Caesar&#x27;s father-in-law, carbonized but preserved by the Vesuvius eruption in 79 AD. Hundreds of these scrolls are unreadable because their carbon-based ink blends in with the carbonized papyrus, and thus are invisible to conventional imaging techniques. Yet, these scrolls are quite possibly on the cusp of revelation.<p>Recent developments have introduced machine learning and high-resolution X-ray scans as methods for reading these &quot;unreadable&quot; scrolls. What texts do they contain? Treatises on science and philosophy? The lost books of Livy? The epic cycle? Governmental policies like the Twelve Tables? It’s a tantalizing question because whatever is locked in those scrolls could be an unfiltered look at the Roman Empire—an empire that fundamentally influenced the trajectory of Western culture, religion, governance, and philosophy.<p>Ponder a history of Rome that has not been retouched by myriadic emperors, by Constantine&#x27;s Christianity, or the interpretive lens of the Roman Catholic Church. Unmediated accounts of Roman society, unaltered by the layers of religious and political power that came later, could rewrite our textbooks and shift the justification of history. It’s not just about enriching our understanding of ancient civilizations; this could be a cornerstone on which to build a fresh philosophical understanding of human society.<p>If the project succeeds, there will be repercussions in the academic realm. The humanities have long struggled to justify their existence in a world that increasingly prizes STEM and lacks any novel sources for the classical world. Suddenly, there could be a concrete, urgent task at hand: to decode, interpret, and integrate an influx of new knowledge. The Vesuvius Challenge could revitalize the field, offering an unforeseen but compelling reason for its study. In essence, it provides a utilitarian justification for the humanities, one that transcends &#x27;cultural enrichment&#x27; and enters the realm of &#x27;historical redefinition.&#x27;<p>The Vesuvius Challenge could be the hinge upon which history swings, yielding intellectual treasure that could be as groundbreaking as the writings that were lost in Alexandria. For millennia, those scrolls have remained unread. Now, it&#x27;s a software problem. That&#x27;s not just a challenge; it’s an imperative.<p>The presence of specific works in the Herculaneum Papyri could dramatically impact our understanding of major historical events.<p>In particular for me, I pray that the biography of Herod the Great by Nicholas of Damascus is discovered intact. While mainstream accounts generally portray the life of Herod within the context of Roman patronage and Judaean politics, uncovering a contemporary account by a close intimate (and used as a primary source by Josephus) would offer fresh, unmediated insights into his rule and its socio-political intricacies. Chronologies of the life of Jesus could be explicitly validated or disproved.<p>The relevance here is far from academic. Consider the following naturalistic hypothesis: that the inception and rise of Christianity was entirely a dynastic struggle within the Hasmonean-Herodian line. What if the tale of Jesus is, in essence, a dramatized, mystified rendition of a 1st-century dynastic conflict, one that was subsequently co-opted and transformed into a religious narrative by an early form of conspiratorial thinking? Something like a 1st-century version of Q-anon, distorting real events to serve an alternative, concealed agenda in the aftermath of the First Jewish-Roman War.<p>Unveiling a document like Nicholas of Damascus&#x27; biography could be groundbreaking in testing such a hypothesis. If Herod&#x27;s life and rule were detailed without the religious overlays that later Christian interpretations bring into the picture, one could make more definitive assertions about the socio-political environment of the time. Furthermore, it could provide concrete evidence to either substantiate or refute theories about Christianity&#x27;s emergence as a byproduct of a Herodian-Hasmonean power struggle.<p>The fact that such a theory could be <i>tested</i> is significant in its own right. Traditionally, discussions about early Christianity rely heavily on religious texts and subsequent historical accounts, many of which are fraught with dogma and ideological interpretations. A primary source devoid of such influences would be a game-changer, offering a baseline of raw data from which more accurate and reliable hypotheses could be drawn.<p>And it&#x27;s not limited solely to Christianity. Rabbinic Judaism could have equally monumental implications as a result. The owner of the villa, likely a wealthy Roman, would be unlikely to have had any primary Hebrew texts like the Pentateuch. However, that doesn&#x27;t rule out the possibility of possessing Greek or Latin works discussing Jewish culture, beliefs, and politics. Given the villa&#x27;s historical context, it&#x27;s conceivable that there might be indirect ethnographic accounts from the period surrounding the destruction of Jerusalem in 70 AD but before the Council of Jamnia, traditionally dated around 90 AD, which helped canonize Hebrew scriptures.<p>Why is this important? The Council of Jamnia is often cited as a crucial moment for the development of Rabbinic Judaism. It allegedly led to the fixing of the Hebrew Bible canon and crystallized what would become Talmudic tradition. If documents were to surface that provide a snapshot of Judaic thought and practice just before this council, it could upend millennia of precedent and identity.<p>In a broader context, discovering pre-Jamnia ethnographic sources could significantly change our understanding of how Judaism adapted and evolved in the aftermath of the Second Temple&#x27;s destruction. This could lead to far-reaching questions. How much of the Talmudic tradition was actually a post-hoc rationalization or systematization of beliefs and practices that were far more fluid before the Council of Jamnia? How much anti-Romanism was pared away to prevent suppression? Moreover, how would such a revelation interact with or even challenge the validity of current Rabbinic and Orthodox Jewish practices?<p>The implications for the Judeo-Christian heritage as a whole are staggering. If both Christianity and Judaism could be traced back explicitly to politically or socially motivated machinations, rather than divinely inspired or time-honored traditions, the entire foundation of Judeo-Christian culture would come into question. In essence, the Vesuvius Challenge has the potential to destabilize two of the world’s major religious traditions at their historical roots. It is difficult to overstate the potential impacts.<p>The Vesuvius Challenge is not just an academic or technological endeavor. Its success could instigate an unparalleled epistemological crisis in religious studies and the humanities. It provides the opportunity to re-examine, with primary sources, the historical foundations of Western religious, cultural, and ultimately political traditions. We&#x27;re not just potentially rewriting history here; we&#x27;re reevaluating the very frameworks through which that history has been understood.
评论 #37863231 未加载
评论 #37870629 未加载
评论 #37868362 未加载
评论 #37862846 未加载
评论 #37864204 未加载
评论 #37864024 未加载
评论 #37864072 未加载
评论 #37870564 未加载
评论 #37863123 未加载
评论 #37867442 未加载
numitusover 1 year ago
From my perspective it may be just fitting to the answer. We try to find symbols, without confidence, that the paper still contains information, and any text for trainig. With &quot;rights&quot; network you can achieve any possibile result. It is remember me a russian freak-scientist, which try to read words and texts on the detailed sun surface photos.
评论 #37870224 未加载
评论 #37868569 未加载
utopcellover 1 year ago
This, along with the way the Antikythera mechanism [1] fragments were decoded [2], always brings to mind the ending of &quot;A.I.: Artificial Intelligence&quot;, where aliens far into the future managed to recreate part of human civilization from remaining artifacts and a barely working robot child.<p>[1] <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Antikythera_mechanism" rel="nofollow noreferrer">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Antikythera_mechanism</a> [2] <a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=6Wp3wL8g2Eg">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=6Wp3wL8g2Eg</a>
评论 #37872163 未加载
Fleusalover 1 year ago
How can they be sure that the results are actual words from the scroll and not just hallucinations of the neural network? If the scrolls are in such bad condition that the data is almost only noise then what stops their high-tech deep learning model from just.. making it all up?
评论 #37884779 未加载
esafakover 1 year ago
It is amazing what some college student can pull off with today&#x27;s technology.
评论 #37868558 未加载
croisillonover 1 year ago
OT: never before have i seen a 2 days old story coming back to the front page
mkoubaaover 1 year ago
&gt; Note that texts from this time didn’t use spaces, making it harder to determine word boundaries.<p>Paging Germans
评论 #37864142 未加载
评论 #37866789 未加载
评论 #37863983 未加载
ejlxshover 1 year ago
Not bad seeing as he solved this while working as an intern at SpaceX too!
adamlgerberover 1 year ago
i love this project. i feel like this is going to be a great source of interest and value over the next few years (and potentially immesurable value over longer time frames).
tclancyover 1 year ago
Somewhat off-topic but if you clicked in here, you might be interested in this book: &quot;The Riddle of the Labyrinth: The Quest to Crack an Ancient Code&quot;.
dexsstover 1 year ago
On a side note iirc there were also some Dead Sea scrolls that were hard to open, were they able to open and read all of the scrolls?
jacobjwebberover 1 year ago
The word is Ancient Greek for “purple”..it takes a lot of reading to find out!
tanhover 1 year ago
Based on this, I wonder if the main challenge has already been solved.
lettergramover 1 year ago
Are they controlling for this? How is the validation being done?
autokadover 1 year ago
imagine the person making this scroll 2,000 years ago wondering &#x27;I wonder if some kid 2000 years in the future is going to win a boat load of money by reading this&#x27;
munificentover 1 year ago
I love uses of machine learning like this a thousand times more than generative LLMs spouting probable-sounding nonsense.
Rallen89over 1 year ago
&gt;Shortly after that, another contestant, Youssef Nader, independently discovered the same word in the same area, with even clearer results — winning the second place prize of $10,000.<p>That&#x27;s what u get for optimising your code
评论 #37862957 未加载
评论 #37860108 未加载
评论 #37863003 未加载
1vuio0pswjnm7over 1 year ago
&quot;He found a few dozen ink strokes - and some complete letters - that could be labeled and used as training data.<p>Before long, the model was unveiling traces of crackle invisible to his own eye. Soon, these traces began to form letters and hints of actual words.&quot;<p>This does not sound like a &quot;Large Language Model (LLM)&quot; or other large set of training data, like the sort hyped by so-called &quot;tech&quot; companies; this sounds relatively small. What am I missing. (Besides brain cells.)
评论 #37865083 未加载
评论 #37866260 未加载
评论 #37862997 未加载
tedunangstover 1 year ago
&gt; Casey was the first person in 2,000 years to find ink — and a letter — inside an unopened scroll.<p>Amusing that this implies the Vesuviuans had the ability to read unopened scrolls.
评论 #37863287 未加载