Showing posts with label chatGPT. Show all posts
Showing posts with label chatGPT. Show all posts

Saturday, August 22, 2026

Handwriting Recognition - A 2026 status check

Background: For years, I had a habit of writing whenever I traveled. No laptop, no apps, just a pen, a notebook, and pages of cursive observations about airports, flights, fellow travelers, and the emotions that come with being away from home. Two decades later, I decided to digitize those notebooks and make them available on Kindle, eventually publishing them as Transit Tales: Between Airports and Emotions: Travel Blog 20 Years Too Late (View on Amazon). As a first step, I assumed modern LLM-powered handwriting recognition would effortlessly convert the pages into text. Instead, the journey led to an unexpected discovery: handwriting recognition is still far from "solved."

The apparent success of modern handwriting recognition is increasingly a combination of imperfect OCR and powerful language-model reconstruction. What users see is often not what the system read, but what the system inferred.

Handwriting Recognition: Better Than It Looks, But Not For The Reason You Think

a hand written page which has been scanned


Modern handwriting recognition demos can be surprisingly impressive. Feed a handwritten page such as the one below into a state-of-the-art OCR system and the resulting transcript may appear almost perfect at first glance. However, a closer examination reveals that the raw recognition quality is often much poorer than it seems. The magic comes not from character recognition alone, but from the language model sitting behind it.

Consider several examples from this handwritten page. The handwritten phrase corresponding to"airport" may initially be recognized as something closer to"surpat". Similarly,"vehicle" can become"valuele","takes a U-turn" becomes"tales a Utum","X-ray machine" becomes"A-vay machine", and"immigration card" appears as"immerdian card". Taken literally, these outputs are poor transcriptions and would be difficult for a human reader to understand without context.

Large language models change the game. Given the surrounding sentence, the model realizes that a traveler arriving at a terminal is far more likely to write"airport" than"surpat","vehicle" than"valuele", and"X-ray machine" than"A-vay machine". The model effectively performs error correction using context, world knowledge, and statistical expectations about language. In other words, it is not necessarily reading the handwriting correctly; it is often inferring what the author probably meant.

This distinction becomes even more obvious with longer phrases. The raw transcription contains fragments such as"want continues - the grove length increase" which are difficult to interpret. Yet an LLM can confidently reconstruct the phrase as"wait continues - the queue length increases". Likewise,"dot Mupose" can be corrected to"what purpose","quese" to"queue", and"lanton" to"London". These corrections are plausible and often accurate, but they are driven at least as much by language understanding as by handwriting recognition itself.

There is an important lesson here. Traditional OCR performance metrics focus on recognition accuracy: did the system correctly identify the handwritten characters? Large language models introduce a second layer that asks a different question: given a noisy transcription, what is the most likely intended text? For users, the final output looks dramatically better, creating the impression that handwriting recognition has become nearly solved. In reality, the underlying recognizer may still be making substantial mistakes, many of which are quietly repaired by contextual reasoning.

The result is both impressive and potentially misleading. If the document contains common travel terms such as airport, boarding pass, London, or immigration card, contextual correction works remarkably well. But when the document contains uncommon names, technical terminology, passwords, identifiers, code snippets, or domain-specific jargon, the same mechanism can "correct" the text into something that is fluent but wrong. Put differently, today's systems often excel not because they perfectly read handwriting, but because they are extraordinarily good at guessing what the handwriting was intended to say.

Summary: Looking at the sample page below, the raw transcription produced words such as"surpat" for airport,"valuele" for vehicle,"A-vay machine" for X-ray machine, and "immerdian card" for immigration card. Yet the final output often looks remarkably accurate because the language model uses context to infer what was probably intended. In many cases, what appears to be excellent handwriting recognition is actually a combination of imperfect character recognition and powerful language understanding. The real breakthrough is not that the machine can read every handwritten word, but that it can often guess the right one.

 Extra Reading:

Confidence is the LLM estimate of how likely the "best guess" matches the intended handwritten word. 
Handwritten textBest guessConfidence
bleambecause / blame20%
surpatairport90%
valuelevehicle95%
canncame85%
tales a Utumtakes a U turn95%
1000per10:00 pm90%
frightflight99%
instid enquiryinitial enquiry80%
want continueswait continues95%
grove lengthqueue length90%
tweekningscreening60%
whoumhmm / whomm30%
bequinbegin95%
mere slowlymove slowly95%
A-vay machineX‑ray machine98%
boarding fan the west itemboarding pass, the next item35%
had baggagehand baggage98%
lantonLondon99%
yhyes95%
dot Muposewhat purpose90%
fan et aromfrom her arm / from a folder20%
gilt the boarding tamgives the boarding pass85%
should Day are of the ben pleasant girlsshould say one of the best pleasant girls70%
tack your bagslock your bags75%
20 1TSA lock? / combination lock?10%
immerdian cardimmigration card99%
quesequeue99%
sigafare vise pageSingapore visa page80%
Monty me in 3001cost me Rs 300/-65%
hundleyhundred85%

Places where context helps.



Tuesday, September 26, 2023

Publishing Journey - Questions and Answers

At what point in your career did you start publishing your works and what really motivated you? 

My journey into publishing my work began during my master's program, although I can't pinpoint the exact moment it started. It was around the time I was pursuing a master's in engineering, and towards the end of my program, I found myself involved in a research project as a research assistant. This project involved classifying ships in the ocean using emerging neural network technology. While the specifics of the project aren't crucial, what mattered was the timing – this was when neural networks were just gaining traction, and I recall the IEEE Transactions on Neural Networks publishing its initial issues around that period. Working with limited computing resources in the early '90s, I achieved some promising results, and it felt like something worth sharing with the scientific community. I was fortunate to be part of a research team that had a strong culture of publishing their findings and presenting at conferences. Seeing the potential of my work motivated me to start writing and documenting my research. The feeling of having your work published and recognized, especially in those pre-digital days when it meant seeing your words in print, was exhilarating. It was at that moment that I realized I had something valuable to contribute to the field. From then on, my publishing journey has been about communicating the work I do. It's important to note that many of us tend to shy away from documenting our work, but if we don't, even our best efforts might go unnoticed. So, motivation came from both the desire to see my work in print or, in today's terms, in digital media, and the necessity to share it with the world effectively. Another aspect that drove me to publish was my innate tendency to document my experiences from a young age. I found immense satisfaction in doing so. Looking back at the paragraphs and writings I penned years ago, it instilled in me a sense of self-confidence and accomplishment. Documenting my journey and research not only preserves my work but also provides a sense of continuity and personal growth over time. In essence, it's a way of validating my own progress and contribution to the world of knowledge.   

How can aspiring authors leverage technology and digital platforms to enhance their publishing experience? 

Today, aspiring authors have a wealth of machine and technology resources at their disposal, making the process of producing their work more accessible. This technological support is particularly significant in the Indian context, where English is often a second language. Despite having learned English in our educational curriculum or attending English-medium schools, it may not be our primary language spoken at home or in natural settings. From an Indian perspective, technology is a game-changer. In the past, we relied on grammar and spell-checking tools, which were quite useful. However, as an author looking to express original ideas that have not been previously published, it's advisable to choose platforms or software that allow you to focus on your thoughts without the burden of formatting. Instead of using "what you see is what you get" document platforms, consider typesetting platforms or software. These tools handle the formatting for you, freeing up more mental space for your writing. You can concentrate on your content without worrying about where to place figures or captions, which can be incredibly liberating. Furthermore, take advantage of the tools at your disposal, such as grammar checkers, which have gained immense popularity. Nowadays, you can even find technological aids that can rephrase sentences to make them more readable or less convoluted. In today's world, we have a plethora of tools available to us. While advanced AI like Chat GPT is an option, for now, focusing on platforms that facilitate idea generation is crucial for authors who are meant to be idea generators. In summary, modern authors have a wide array of technological resources to streamline their writing process, and selecting the right tools can greatly enhance their productivity and creativity.

As an author what challenges have you typically faced during the publishing journey, and how could you overcome them?

The challenges in the realm of publishing vary depending on the type of publication you are aiming for. For instance, when you're working on a journal paper or a conference paper, one immediate challenge is meeting the deadlines set by the publication. Knowing the precise date by which you must have your manuscript ready can be both a blessing and a challenge. Moreover, these publications typically have strict page limits, which means you must condense your content effectively. It's akin to composing a telegram for those who remember; every word must count. On the other hand, writing a book presents a different set of challenges. Writing a book is more like running a marathon. While there may not be rigid deadlines, you often set softer ones for yourself. It becomes a journey of self-motivation, as there's no external pressure. When you commit to writing a book, you embark on a self-discipline journey. Unlike journal papers, where the publication process is streamlined and deadlines are clear, writing a book requires consistent effort and determination. Fortunately, in today's publishing landscape, many publishing houses offer preset formats, making formatting concerns less of an issue. You can focus on your writing, and the rest is taken care of by the publishing platform. However, the primary challenges shift towards the content itself. Ensuring originality and avoiding plagiarism becomes crucial. While plagiarism checkers can help, the ultimate responsibility lies with the author to maintain academic integrity. In summary, the challenges in publishing differ based on the type of publication, with journals having stricter deadlines and page limits, while writing a book demands self-discipline and originality. Modern publishing platforms have streamlined many aspects of the process, but authors must remain vigilant about maintaining the integrity of their work.

What advice would you give to individuals who are passionate about sharing their knowledge but may be hesitant yet to take the leap into the world of publishing?

Here's some straightforward advice: If you have the passion and knowledge to share, there's nothing to fear about publishing your work. There are numerous avenues available for getting your ideas out there. Start by identifying what truly excites you and what you're eager to write about. Don't obsess over crafting linguistically elaborate prose. Most ideas can be effectively communicated using simple vocabulary, and you don't need an extensive vocabulary to make a meaningful impact. If your goal is to publish, and you have a substantial amount of material, then you mostly need the discipline to organize it. Be prepared for multiple rounds of editing. Writing a longer piece, such as a book, is akin to translating your thoughts onto paper and then meticulously refining them through deletions, revisions, and rearrangements. Even after numerous edits, you may still feel like it could be better – it's a bit like working on your thesis up until the last day of submission. Remember, a manuscript is never truly in its final form until you submit it. Focus on your passion for writing and don't overly concern yourself with how many people read your work or the number of likes and thumbs-ups it receives. The key is to channel your passion and take that leap. You don't need to aspire to be a wildly successful author; you simply need to express yourself. Writing can actually be more forgiving for introverts compared to extemporaneous speaking or addressing a crowd. It provides a platform for introverts to articulate their thoughts and feelings through text, making it a valuable means of self-expression. So, embrace your passion and start writing without hesitation. There's nothing holding you back.

Sunday, January 29, 2023

Need for Detect ChatGPT to protect ChatGPT

Some Background

ChatGPT has attracted a lot of attention because of the ability to generate text which while being grammatically correct most of the time happens to also be very conveniencing  to an extent that unless you are _actually_ aware of the _reality_ you might believe what the machine learning model, which is estimated to have cost 1.2 billion USD to build with your and my contributed English text data, is factually correct.

This has spiked debate on if students will outsource their school homework to ChatGPT when they are asked to do their homework. Lets keep aside the fact that even before ChatGPT attracted our eyeballs there was homework outsourcing, it was to pay for the service of an actual _human_ do their tasks.

Note that using ChatGPT to do homework is interpreted as cheating. Teachers always think that students are out there to find an easy way to accomplish the task assigned to them;  never questioning their inability to frame tasks that would actually require the students to demonstrate their learning.

Consequently, there has been an engaging debate on identifying text generated by ChatGPT to _help_ teachers identify if the student is indeed the author of the text or if s/he used the services of a AI bot used (underlying assumption is if they were unfair in completing their task)!

Detect ChatGPT is an outcome of this, a portal (I was not aware there was a portal for this until now!) that will allow one to differentiate between human generated text and machine generated text. A plagiarism checker if you wish.

First we research and build ChatGPT and then we realize that this can be used unfairly (by students!) so we come up with a brand new research problem to detect ChatGPT generated text & newspaper headlines "Stanford introduces DetectGPT to help educators fight back against ChatGPT".

 

"Solved Research problems lend themselves to new research problems --Anonymous" 

can not be less true!

 Going Forward

 

 Note that according to openAI, the creators of ChatGPT, ChatGPT has digested almost all the visible English text data that was available on the internet. So at some point of time in the near future the current version of ChatGPT is going to lagging in terms of being informative. 
 
For example say if a company released a new oral vaccine for COVID19 after the ChatGPT was released, then it would not be aware of it because the information corresponding to that would not been digested by the AI model ChatGPT.
 
Sooner or later,  for the above stated reason, at some time in future, the creators of ChatGPT will see a need for their large language model to be upgraded. 
 
See the above picture; "A" is when the ChatGPT was released and say "E" is the point at which, the upgrade is deemed required; the distance between "A" and "E" is the time between two versions of ChatGPT! 
 
The period between A and E, the world is doing what it does best, generate lots of text data. Except that there is an additional source (you guessed right, ChatGPT) generating data. This is shown by the "red" line. It text generation starts with the introduction of ChatGPT (point "A") and it is likely to overtake the "usual modes of" text generation by humans in terms of volume of text generated. 
The hump on the red line indicates the hype - more and more people trying things out using ChatGPT and then putting the generated text out on the internet to shout their findings!
So at some point E, when a ChatGPT upgrade  is envisioned. The upgraded version would digest more of its own generated text (pictorially the area between the two red lines) that the text that has come from usual sources (human; pictorially the area between the two blue lines) of text generation. In some sense it is learning from itself! 
 
This scenario could lead the upgraded ChatGPT into chaos especially if the output of the current ChatGPT is bullshit (as mentioned in  this article). So if more  and more bullshit text generated by ChatGPT is used to train the next version of ChatGPT; the output is going to be more bullshit (what ever that means). Making the upgrade unusable ...

Unless
  1. After the initial hype the text generated by the ChatGPT is reduced (pictorially it is the area between the red dotted lines; denoted by length between points "H" and "I") compared to the usual modes of text generation (by humans; pictorially it is the area between the blue lines; denoted by length between points "G" and "J"). So that the next version of ChatGPT learns from the "new" and "usual" text data than data generated by itself.
  2.  there is a way to identify the text generated by ChatGPT, namely detect ChatGPT! This mechanism can then be used to filter out text generated by ChatGPT, thereby allowing the upgraded version of ChatGPT to only learn from human generated text and not be biased by the text generated by its older version. All this can happen if the detect ChatGPT works to perfection. However, like all explorations, the ability to achieve good accuracy takes time.

While time will tell about #1. There is a definite need put all research might behind exploring methods to detect ChatGPT generated text data. This is probably the only way that ChatGPT will survive.
 
What do you think?

A Lesson Hidden in Two Simple Words

Sometimes profound ideas are hidden in the most ordinary places. Recently, while looking at two common English words, I stumbled upon an int...