Jerry Liu

you know what, i'll take it (as a max user 🙏)

RT simon Do you eventually wrap around to series AA

this is just twitter

This week we had a huge global company onsite in SF 🌉 (the company has 2x’ed in size since our last one!) We solidified our roadmap towards becoming the best document infrastructure for AI agents. We’re building a cracked AI lab focused on all aspects of document work - from document OCR, extraction, search, to e2e workflows - and hillclimbing our capabilities through model training, agent engineering, and deep infrastructure expertise. We’re also committed to building the most comprehensive, unbiased benchmarks to advance the Pareto frontier for all document tasks. ParseBench has 2k+ enterprise pages, ~80 solutions verified, 15k monthly downloads, and is available across HuggingFace and Kaggle. Next up is increasing our dataset (more verticals) and task coverage (e.g extraction). LlamaParse agentic and cost-effective modes directly define the Pareto curve for VLM-based OCR solutions and we’re making rapid leaps across complex tables, charts, fonts, layouts and more every single day. In addition, liteparse is the fastest, most performant free parser out there and is quickly becoming one of the most popular, eclipsing 11.5k+ stars in ~2 months. This week we did some work and had a lot of fun. Maybe a little too much fun 😅: * Spraypainting * Darts * Topgolf * Escape Room * Soccer * Many dinners * Raising Canes for lunch Time to lock back in. You’re going to see us ship an insane amount of stuff in Q3.

RT LlamaIndex 🦙 Teaming up with http://You.com for their Agentic Hackathon at the AWS Builder Loft in SF, July 24th. One day to build agents on live web data - real-time intelligence, deep research, or multi-agent systems - then demo to the judges. RSVP here: https://luma.com/youdotcom-agentic-hackathon-sf

This is absolutely insane. Having a huge proliferation of Chinese open-source models that are winning on task-specific benchmarks may not be great for American AI dominance. But - it is fantastic news for every non-frontier lab out there. Every American AI startup will survive by distilling from the latest open-weight models, instead of solely depending on the frontier labs.

RT Murtaza Khomusi Tech ads traveled with me to NJ. World Cup fever or permanent?

RT Murtaza Khomusi OMW to SFO I see two of my busses and a billboard on the 101. I feel very complete.

We Parse PDFs 📑 company photoshoot

RT Murtaza Khomusi vibez are g00d @llama_index

I do think that for any given task, you can always distill a generalized model/agent harness into a specialized model/harness/workflow for higher accuracy and lower cost. The more narrow the data and task domain, the more opportunity there is to optimize performance (not to mention provide a more targeted UX vs. a chat interface). As agents get better at improving themselves, I think you can start to perform this distillation automatically, by defining a top-level goal and evaluation rubric, instead of codifying the workflow through code or natural language.

Parse PDFs at lightspeed through grpc liteparse already had a REST API, but now we've built in support for liteparse as a grpc service with typed fields through protobufs. This is great if you're looking to have fast, efficient document parsing within your backend services. Check it out: https://www.llamaindex.ai/blog/introducing-liteparse-grpc-a-grpc-server-for-liteparse?utm_medium=socials&utm_source=twitter&utm_campaign=2026-jul-

RT LlamaIndex 🦙 Document processing pipelines are often made up of multiple services: parsing → chunking → embeddings → storage. Until now, LiteParse was only available over REST. That works well for browsers and simple integrations, but it’s not always the best fit for service-to-service communication. Today we’re introducing liteparse-grpc. With @𝘭𝘭𝘢𝘮𝘢𝘪𝘯𝘥𝘦𝘹/𝘭𝘪𝘵𝘦𝘱𝘢𝘳𝘴𝘦-𝘨𝘳𝘱𝘤 (npm) or the 𝘨𝘩𝘤𝘳.𝘪𝘰/𝘳𝘶𝘯-𝘭𝘭𝘢𝘮𝘢/𝘭𝘪𝘵𝘦𝘱𝘢𝘳𝘴𝘦-𝘨𝘳𝘱𝘤 Docker image, you can run LiteParse as a gRPC service and: 📄 Parse PDFs, Office documents, and images into JSON, text, or Markdown 📸 Render PDF pages as screenshots 📊 Estimate document complexity and whether OCR is needed The package also includes a CLI client for testing, generated TypeScript client stubs and the protobuf definitions, so you can generate clients for Python, Go, Java, or any other language supported by 𝘱𝘳𝘰𝘵𝘰𝘤 The REST server isn’t going anywhere, this is simply another interface for teams building polyglot, microservice-based document pipelines. 📖 Read the full breakdown: https://www.llamaindex.ai/blog/introducing-liteparse-grpc-a-grpc-server-for-liteparse?utm_medium=socials&utm_source=twitter&utm_campaign=2026-jul- 💻 GitHub: https://github.com/run-llama/liteparse-server

RT Quinn Leng Good analysis. Maybe more specifically we can say it's "intent specific"? And capturing that intent behind the intent is so challenging.

http://x.com/i/article/2077182007139037185

RT Murtaza Khomusi Busy at work. Thank you, @OpenAI .

Extracting information from millions of documents at scale used to take an insane number of human hours. Even with recent OCR + document AI tech, humans would still have to spend a lot of time carefully tuning the schema and precisely defining the fields they want to extract. We've launched a Conversational Extract feature within LlamaParse that now lets you define and run complex document extraction through a conversation. 1️⃣ Describe the fields you want to extract, and upload a reference document 2️⃣ Refine the document schema directly, or through additional conversations. Select the right level of agentic reasoning needed 3️⃣ Run extraction at scale over 1M+ docs. Get bounding boxes, citations, and confidence scores for every single extracted field. Check it out today: https://cloud.llamaindex.ai/

enemy of my enemy is my friend type shit

RT LlamaIndex 🦙 Your extraction schema is now a conversation away. ⁣ 📄 Upload a doc — the agent drafts the schema from it⁣ 💬 Want changes? Just ask⁣ 📚 Or grab a template and go⁣ ⁣ Writing JSON Schema by hand? That's over.⁣ ⁣ Conversational Extract is live in LlamaParse. Try it now at https://cloud.llamaindex.ai?utm_medium=socials&utm_source=twitter&utm_campaign=2026-jul-

Work hard play hard 🇫🇷🇪🇸

100%. If I'm driving on the 101 it is a life hazard to read verbose billboards

If you're a founder, come pitch your wildest ideas to other founders in a safe space! Food and drinks included 🍹

Our team made the cutest graffiti art yesterday 🎨

RT LlamaIndex 🦙 Co-hosting 'Swap and Pitch Night' this Thursday in SF with @tembo, @clerk, and @autonomaai. Pitch night where founders pitch each other's startups. Good test of whether you actually listen, and sometimes someone pitches your startup better than you do. 855 Brannan, 6 to 8:30pm. RSVP here: https://luma.com/swapandpitch

RT LlamaIndex 🦙 We eat docs🫢

Agreed with this. people underestimate the importance of good abstractions and maintainability. part of the reason LLMs/AI are so popular in the first place is because of the ease of using the models during inference-time (through prompting, orchestration) instead of training

OpenAI is absolutely cooking this week

There is a massive opportunity for any startup to build specialized, domain-specific workflows that are at the Pareto frontier in accuracy, cost, and latency. It is clear that not every task requires frontier intelligence (e.g. 5.6 Sol xhigh). Every single task has an optimal model+harness configuration in order to solve that task in an accurate, cheap, fast manner. This holds true even as frontier models get better! We see this as being especially true for document OCR. We think there will always be a massive gap in the Pareto frontier for document OCR vs. frontier model capabilities for visual understanding. Over the past year, we’ve invested massive amounts of research efforts in building auto-routing harnesses, fine-tuned layout models, and specialized models for specific elements within the document distribution - tables, charts, handwriting, and more. All this applied research makes its way towards making LlamaParse the best document processing service out there. Come check it out: https://cloud.llamaindex.ai/

Parse any PDF into agent-ready context. Fully local, free desktop app. No model / internet connection required!

congrats on the launch! As the task horizons on agents gets longer, we need more work evaluating and training models to be better in long-running, open-ended, evolving real-world environments.

RT Skyfall AI Today we present Morpheus, a persistent enterprise simulation platform designed to make Continual Learning a reality. Morpheus is the world’s first real world Reinforcement Learning environment. Every Reinforcement Learning environment operates in the game world. Benchmarks like Atari, OpenAI Gym, MuJoCo, and Procgen are all small, game-like worlds that reset every few minutes. But the real world never resets. A business keeps running and evolving everyday. We tested how frontier LLMs would perform in realistic and dynamic business environments 🧬on Morpheus. The main conclusion was that LLMs are not continual learners. 🧵Here’s how we did it and what we learned:

RT LlamaIndex 🦙 Ever wanted to quickly turn a PDF into clean text to paste into your favorite AI agent, without having use CLIs or open the browser? We built exactly that. Using @TauriAp ps, with a Rust backend powered by LiteParse and a React frontend, we created a cross-platform desktop app that lets you: • Drag and drop PDFs • Convert them into clean Markdown • Preview page screenshots with extracted bounding boxes overlaid for easy inspection It's a simple way to understand your document's structure and verify the parsing results before handing them off to an LLM. Check out the demo below! 👇 GitHub: https://github.com/run-llama/liteparse-desktop Get started with LiteParse: https://developers.llamaindex.ai/liteparse/

lmao

sama scrolling AI Twitter like the rest of us

wtf I thought this was AI cc @disiok

We comprehensively benchmarked GPT-5.6 on document understanding. At a high-level there's no change between GPT-5.6 Sol and GPT-5.5 in terms of performance over tables, text, charts, layout, and more. The GPT-class of models typically does quite well over table understanding, but they struggle with transcribing complex text layouts and formatting, with transcribing charts, and with deriving bounding boxes over source elements. Come check out our leaderboard of over 70+ frontier models, open-weight models, and OCR solutions on ParseBench: https://www.parsebench.ai/

RT LlamaIndex 🦙 Re @OpenAI released GPT 5.6 today and we ran a day 0 benchmark in ParseBench to test improvements in document understanding. The new family of models continues to excel at reading text and tables, but continues to struggle with charts and layout. What's most interesting is that Luna is about 6 x cheaper than Sol and only results in minor degradations across all ParseBench metrics, showing that an increase in reasoning tokens doesn't always result in a commensurate improvement in visual understanding.

Actually I did a quick test. I like the ChatGPT Work/Codex split better than Claude Cowork/Code. The interface is much more unified. The functionality is effectively the same. The chat history is shared between the two modes. The team put more care into the specific toggles that should feel different between knowledge work and code.

ChatGPT Work == Claude Cowork ChatGPT Codex == Claude Code I kinda wish OpenAI created a single unified app surface for all work, coding or not, even though I get the UI/UX would be different

RT LlamaIndex 🦙 Low user caps in LlamaParse? Gone.🎉 Every plan — Free through Pro — now unlocks up to 100 team members. No more picking who gets a seat. No more shared logins. No more upgrading just to invite a teammate. Whether you're a two-person startup on the free tier or a team scaling on Pro, your whole team can now build together, same workspace, same projects, every tier. True team collaboration is now the default, not a premium feature. Signup for free and invite your team today --> https://cloud.llamaindex.ai?utm_medium=socials&utm_source=twitter&utm_campaign=2026-jul-

Congrats to our llama cousins 🫡🦙

You don't need heavyweight VLMs to OCR simple text-only PDFs. Doing that is like bringing a bazooka to a knife-fight, and is completely unnecessary and worse quality than a tuned OCR approach. Output tokens are expensive and slow. Reading text as images hurts transcription accuracy. We've built an improved routing layer in LlamaParse that picks the right level of document parsing capability depending on the complexity of the page. If the page is simple/text-heavy, we'll use our cost-effective techniques. If the page contains dense tables or charts, we'll revert to a heavier VLM-based approach in our agentic mode. You can toggle this in one-click in the product! Check it out: https://cloud.llamaindex.ai/

RT LlamaIndex 🦙 Introducing: Granular job tracking and cost attribution in LlamaParse 🦙 Parsing thousands of pages a day is a lot to manage. Engineering teams need to have a pulse on what's running, who ran it, and what it costs. Our latest tagging system make it easier to track and attribute usage and costs at scale in LlamaParse: 🏷️ 𝗨𝘀𝗲𝗿 𝗠𝗲𝘁𝗮𝗱𝗮𝘁𝗮: Always know where every job belongs. Attach your own labels to any parse job and they come back on every response. 🏷️ 𝗨𝘀𝗮𝗴𝗲 𝗧𝗮𝗴𝘀: Know what your document processing actually costs, by project and by team. Tag your requests, and your spend becomes filterable by those tags: by customer, by team, by product line, whatever makes sense for your org. 🏷️ 𝗦𝗶𝗴𝗻𝗲𝗱 𝗪𝗲𝗯𝗵𝗼𝗼𝗸𝘀: Trust every callback you receive. Every webhook delivery now includes an HMAC signature, so your systems can verify a callback really came from us before acting on it.

RT LlamaIndex 🦙 We've rolled out improvements to LlamaParse Cost Optimizer. Our intelligent tier routing now more reliably ensures you always strike the right balance between cost and accuracy when processing large documents. Simple pages default to our cost-effective tier, complex pages are still processed by our higher accuracy and higher cost agentic and agentic plus tiers. Only pay for the quality each page actually needs. Live now for all customers.

RT Logan Markewich Whats the tesseract equivalent for schema-based extraction? Tesseract gives fast and dirty OCR for ~free. But what about pulling out a specific schema?

RT LlamaIndex 🦙 Most agentic retrieval demos assume clean, well-structured documents. Enterprise reality is often different, consisting of messy PDFs where critical information is buried across tables, figures, and complex layouts. That’s why we teamed up with @lancedb to explore how LiteParse (our lightning-fast parser) combined with LanceDB’s native multimodal storage can improve retrieval quality and agent response accuracy. By separating PDFs into multiple information layers - pages (text + screenshots + embeddings), chunks, and extracted assets - and storing them in LanceDB for fast multimodal retrieval, we built a hybrid pipeline that unlocks information traditional RAG systems often miss. Instead of relying on chunk-level retrieval alone, agents can retrieve and reason across pages, chunks, and visual assets, making complex enterprise PDFs far more accessible. The result is a significantly stronger retrieval foundation for agentic workflows. 📖 Read the full breakdown in the blog post: https://www.lancedb.com/blog/from-messy-pdfs-to-verifiable-answers-with-liteparse-and-lancedb 💻 Explore the full implementation on GitHub: https://github.com/lancedb/liteparse-lancedb-pdf-qa

Is this what founder mode looks like

There is a massive demand for processing files *in the agent loop*. The number of users submitting agent queries with file attachments is exponentially increasing over time. Our mission is to make LiteParse the best parser in terms of cost, accuracy, speed, and semantics, for any agent loop you're using. This includes the recent Eve framework by @vercel to the Claude SDK to other frameworks. Right now, the default behavior of every agent loop is to use a simple library (e.g. pypdf, pdftotext) to do a light pass through the file, before attempting deeper vision based approaches. This leads to hallucinated context, and bad retrieval. This also takes a long time, because the agent has to reconstruct writing the imports/postprocessing code from scratch. LiteParse is awesome and you should check it out. Even if you don't plan to use it as a standalone library, it is installable as a one-click skill for any agent, and of course, we now support Eve! Template: https://github.com/run-llama/eve-liteparse LiteParse: https://github.com/run-llama/liteparse

We've created a comprehensive Retrieval Harness for modern agentic retrieval in 2026. The harness provides a persistent data pipeline that can connect to a data source, index and update a large knowledge base, and expose a broad set of tools akin to filesystem operations (semantic/keyword search, regex grep, file search, read). You can plug this into any of your agents to let them autonomously crawl an arbitrary knowledge base to solve a task with any complexity. Check out our reference implementation: https://github.com/run-llama/legal-kb LlamaParse: https://cloud.llamaindex.ai/

Happy July 4th everyone 🇺🇸 250 years ago, our founding fathers did not have access to frontier models. (Alexander Hamilton wrote 51 of the 85 Federalist papers. Imagine how many he would've written if he had access to Fable) All jokes aside, America continues to be the place where the best people come to learn, build and innovate. Proud to call this country my home.

I’ve gotten reasonable success by creating a skill that reflects my writing style, and hillclimbing the skill based on my real writing samples. I think that solves 70% of the style problem, though doesn’t solve the inherent ability to articulate clear, differentiated insights, which is probably an inherent posttraining problem

Hello brother

You are going to end up running hallucinated code

RT Conor Bronsdon .@aiDotEngineer World's Fair was one of the most unique, interesting conferences I've been to: - incredible conversations with builders - hilarious & creative touches (shout out @swyx) from a flash mob to cleric costumes and the integration of the USMNT game - a @altryne / @thursdai_pod livestream alongside excellent talks + stellar side events like the Agent Open by @jerryjliu0 + @murtazakhomusi & @morgane_paloma Fantastic week with @chaoyu_ & the rest of the @Modular team - exciting times ahead in AI!

RT LlamaIndex 🦙 The team at @vercel recently released the Eve agent framework, so we built a template that integrates LiteParse with it🦙 The template provides a set of read-only filesystem tools that let Eve resolve paths, list directories, and read text-based files. We then pair those with LiteParse, which parses files from their source and returns clean, structured Markdown⚙️ Finally, we equipped the agent with detailed instructions on when and how to combine these tools effectively, giving it a reliable workflow for navigating and understanding document collections out of the box📁 The result is a solid starting point that you can extend with your own channels, tools, and skills🔧 Check it out: https://github.com/run-llama/eve-liteparse

the scroll feature in the claude code CLI is really nice

3 years ago I gave a talk at the first @aiDotEngineer conference on "Advanced RAG" techniques in order to work around the limitations of naive RAG. It's insane how much the world has changed since then, and the world has evolved into standardized, higher-level abstractions around agent harnesses and context. Some general patterns: 1. Retrieval complexity can be encoded at the agent layer. This means that you can give relatively simple but performant search tools to an agent (e.g. really fast bm25, vector search), and let the agent reasoning enter the right queries to find the right results. 2. To some extent this is still evolving, but I do think we will increasingly care less about "hacking" the context window and more about deciding what business context is relevant in the first place. 3. The way we build agents has fundamentally changed from defining code, to defining runbooks, to defining goals. Big congrats to @swyx and the entire AI Engineer team for continuing to put out awesome conferences every year.

Re credits @murtazakhomusi

OOH campaigns in SF be like

RT Gergely Orosz Re Part 2, w @ankrgyl, @bernhardsson, @Sirupsen, @jerryjliu0, @travers00, @Steve_Yegge, @addyosmani And what a game @grinich And many others! Also @swyx AIE is 🔥, how is it better every year??

when you have fomo but not enough use cases

RT simon Are there any CS profs left at Berkeley and Stanford? Might as well just merge all the PhD students into the big labs at this point

RT LlamaIndex 🦙 Agentic retrieval is changing the way retrieval-augmented applications are built, especially in domains like legal and fintech, where agents need to autonomously navigate large, evolving knowledge bases. That’s exactly the use case we designed Index v2 for. To demonstrate what’s possible, we built legal-kb, a reference application that integrates Index v2 into an agentic knowledge automation workflow. It uses Index v2 as the underlying knowledge base and exposes its retrieve, read, grep, and find APIs as tools that an AI agent can use to autonomously explore and reason over your documents. With legal-kb, you get: 📚 Project-scoped knowledge bases for agent-powered chat 📖 Visual citations directly in agent responses 🌿 Version control for your knowledge base 📦 Data export capabilities Try it out: https://legal-kb.dev Explore the code: https://github.com/run-llama/legal-kb Get started with LlamaParse: https://cloud.llamaindex.ai/signup

This was an awesome collab between 7 companies 🔥 Huge shoutout to @browserbase @modal @braintrust @turbopuffer @p0 @cursor_ai and of course our very own @llama_index teams. For those who attended - hope you enjoyed the pickleball, food, drinks, and Wimbledon-inspired swag :)

RT Ankur Goyal Super fun to touch grass with friends from @turbopuffer @modal @llama_index @p0 @browserbase @cursor_ai

RT morgane palomares The Agent Open was a galaxy brain idea that @murtazakhomusi and I did together — couldn’t be happier we went for it. See you at the next one ;)

We are SO back

RT Anthropic Claude Fable 5 will be available again globally tomorrow. After a series of productive conversations with the US government, we're redeploying the model with a new set of classifiers to target and block more cybersecurity tasks. In the near term, some routine tasks like coding and debugging will fall back to Opus 4.8. We’ll continue to refine these classifiers over the coming weeks to reduce false positives and better distinguish genuine misuse from legitimate requests. We’ve also begun drafting a consensus framework—with Amazon, Microsoft, Google, and other Glasswing partners—for assessing the severity of AI jailbreaks and how AI developers should respond to them. We invite other industry partners and model providers to join us in this effort. Finally, we’re scaling up our collaboration with the US government on model testing and safeguards. This will include pre-release access to models and safeguards for evaluation, information sharing on jailbreaks and misuse, and dedicated resources for joint research. Thank you to our users for your patience, and to our partners across the government, industry, and the research community who worked alongside us to make Fable 5 available again. Read our full blog: https://www.anthropic.com/news/redeploying-fable-5

Fable 5 back Lebron possibly to the Warriors AI eng world fair it's a good week to be in SF

RT LlamaIndex 🦙 Doors are open at Agent Open, right next door to AI Engineer Two courts, blue sky, no fog (a San Francisco miracle) 🌤️ This is the perfect walk-over window, we are just 3 minutes from Moscone. Don't miss the State of AI panel at 5PM, tournament + party til 10PM. RSVP: https://luma.com/the-agent-open?utm_medium=socials&utm_source=twitter_li&utm_campaign=2026-06

Fully solving document parsing includes covering every point on the Pareto curve of accuracy, cost, and latency: 1️⃣ High-accuracy parsing - requires 99%+ accuracy, price insensitive. Especially relevant in regulated industries like financial service and insurance. 2️⃣ Low cost, high volume parsing - requires inhaling a massive volume of documents as context for agents. Can run offline in a batch setting. 3️⃣Low latency and low cost parsing - these are use cases where the user is uploading a massive volume of files ad-hoc and in the agent loop (e.g. uploading 1k pdfs to claude cowork). Requires an extremely fast pass to make sense of the docs before a deeper dive LlamaParse covers the cost-accuracy modes for document OCR with our document agent harness. LiteParse, our OSS project, is designed to be in the agent loop, and can route to deeper VLM-enabled modes. I talked about this and other topics during the @aiDotEngineer talk today. Stay tuned for the slides! In the meantime, check out our full set of parsing results on ParseBench: https://www.parsebench.ai/ LlamaParse: https://cloud.llamaindex.ai/ LiteParse: https://github.com/run-llama/liteparse

RT LlamaIndex 🦙 We just made it a lot easier for AI agents to work with your documents. LlamaParse MCP now does more than parse or classify files: it can pull structured data out of contracts, invoices, and reports automatically, and give agents direct access to your knowledge base (PDFs, Office docs, images, and more) so they can search, read, and retrieve information just like a human would. We also reorganized everything into focused, purpose-built tools: whether you're classifying documents, extracting data, or building search over your company's files, agents can do it faster, more reliably, and in parallel. This allows for smarter, more capable AI workflows for anyone working with documents at scale. Curious to try it out? Get started now with the LlamaParse Platform → https://cloud.llamaindex.ai?utm_medium=socials&utm_source=twitter&utm_campaign=2026-- Blog post: https://llamaindex.ai/blog/extending-the-llamaparse-mcp-for-more-document-processing-power?utm_medium=socials&utm_source=twitter&utm_campaign=2026-- Take a look at the GitHub repository → https://github.com/run-llama/mcp-llamaindex-ai

RT Lukas Levert Today’s the day. The inaugural Agent Open is here and it’s gonna be awesome. Arrive early, play some pickleball, meet some people, eat good food, and enjoy the panel featuring @travers00 @ankrgyl @Sirupsen @jerryjliu0 and @bernhardsson, moderated by @GergelyOrosz.

Come for the Germany games, stay for the Raising Canes 🇺🇸🇺🇸🦅

This is a neat idea around doing model routing and sub-agent delegation while ensuring cache hits on accumulated context for all agents. It makes a lot of sense: you want to ensure that all subagents can also make use of accumulated context in their cache

Which AI engineer is GOATed at pickleball? Come find out tomorrow! https://luma.com/the-agent-open?tk=F0FFFy

We're excited to introduce the Retrieval Harness in LlamaParse - which is the 2026 version of RAG over documents Generalized agents need the right set of tools to scalably search and read through an arbitrary corpus of data (from 10 docs to 1m+ docs). They can already demonstrate great retrieval performance over a local filesystem, need a proper backend for a large collection of managed data. The Retrieval Harness exposes a diverse set of tools for various needs: 1. Hybrid Retrieval: Combine vector search with keyword search, let the agent set the alpha value to toggle between the two 2. List Files: a scalable version of `ls` to list files within an index 3. File Grep: enable regex search within a given file 4. File Read: Allow agents to read a subsection from an existing document. The agent can choose to interleave any sequence of these tools in order to complete a variety of tasks, from simple to hard. Come check it out! Blog: https://www.llamaindex.ai/blog/announcing-retrieval-harness?utm_medium=socials&utm_source=twitter&utm_campaign=2026-jun- Sign up to LlamaParse: https://cloud.llamaindex.ai/

RT LlamaIndex 🦙 Semantic search alone doesn't cut it. Neither does brute-force grep. Agents need both. Today we're shipping the Retrieval Harness in LlamaParse Index: semantic search, server-side grep, and file-level navigation working together in a single agent reasoning loop. 🦙🌤️ Grep a file, list what's in an index, read past a chunk boundary, run hybrid search with reranking — all as native agent tools. Now in beta across all paid tiers. Full breakdown in the blog 👇 Learn More: https://www.llamaindex.ai/blog/announcing-retrieval-harness?utm_medium=socials&utm_source=twitter&utm_campaign=2026-jun-

RT LlamaIndex 🦙 We're all over AI Engineer World's Fair on June 29 to July 2. 🦙 📍Visit us at booth L-G47. LlamaParse demos + Fear of Docs swag 🎤 @jerryjliu0, our Founder & CEO, on agentic document parsing and shipping agents that survive production. Tue 6/30, 11:10 AM, Vision & OCR (Room 2006) 🎤 George He, our Head of Engineering, in a live parse-off, LlamaParse vs the leading LLMs. Thu 7/2, 1:55 PM, Expo Stage 4 🥒 The Agent Open (6/30) RSVP 👉 https://luma.com/the-agent-open?utm_source=x&utm_medium=organic_social&utm_campaign=aiewf-2026

RT LlamaIndex 🦙 We're all over AI Engineer World's Fair on June 29 to July 2. 🦙 📍Visit us at booth L-G47. LlamaParse demos + Fear of Docs swag 🎤 @jerryjliu0, our Founder & CEO, on agentic document parsing and shipping agents that survive production. Tue 6/30, 11:10 AM, Vision & OCR (Room 2006) 🎤 George He, our Head of Engineering, in a live parse-off, LlamaParse vs the leading LLMs. Thu 7/2, 1:55 PM, Expo Stage 4 🥒 The Agent Open (6/30) RSVP 👉 https://luma.com/the-agent-open?utm_source=x&utm_medium=organic_social&utm_campaign=aiewf-2026

Agreed with this. There's a lot of value in both agents and software (i don't think SaaS is dead), but the product interfaces are different: 1. An agent is like a human. There are a core set of interfaces for communication, and they can be relatively simple (chat, voice, slack) 2. Both humans and agents need software as tools. The best interface for each tool depends heavily on what its being used for (ticket tracking, CRM) Right now it makes sense that every SaaS company is building agents to capture the value of work automation, but I do think the interfaces will unbundle between the two over time.

RT Afiz ⚡️ It really isn't an exaggeration! LiteParse clocks in at an average of 3ms per page for a reason: it skips the heavy AI processing and cloud overhead entirely. Here is exactly how it pulls off that kind of speed: - Purely Local & Lightweight: It runs completely on your machine (built on a Rust core with a native PDFium C library) rather than sending files over the network to a distant cloud server. - No Heavy VLMs/GPUs: Instead of using an expensive, slow Vision-Language Model to "read" the page layout, it relies on fast, deterministic layout heuristics and projects text onto a spatial grid.   - Selective OCR: It only activates OCR (using lightweight engines like Tesseract) when it encounters scanned pages or embedded images; otherwise, it extracts native text layers directly.   Because it reconstructs headings, tables, and lists into structured Markdown almost instantly, it's a massive win for real-time RAG pipelines and coding agents that need a quick first pass over documents. Quick demo 🧵👇

From playing around with /goal It feels like there's less and less of a need to build any type of workflow manually (whether through code, drag and drop, or a prompt). Instead, specify the goal, let the model intelligence figure out the underlying steps. If the task is repeatable, then you can gather a dataset with ground-truth, and hillclimb it for increased cost / lower accuracy. To some extent this is what every non-frontier lab is optimizing for. The world is moving from prompt engineering -> goal and eval engineering.

LiteParse is unreasonably good for document parsing ✅ It is the fastest document parsing tool out there - average parse time per page is 3ms ⚡️⚡️ ✅ Now that we support markdown, it tops opendataloader-bench, OlmOCR-bench, and ParseBench in terms of accuracy ✅ It supports 50+ other document formats ✅ It even gives you basic bounding boxes that your coding agent can stitch together Even if you need deeper VLM-enabled parsing (e.g. LlamaParse), there's no reason you shouldn't be using this as a first pass for everything. https://github.com/run-llama/liteparse

RT LlamaIndex 🦙 The @n8n_io node for the LlamaParse Platform is now an officially verified community node, as part of a broader partnership with n8n to bring cutting-edge document intelligence to the low-code and no-code world🚀 The new version of the node brings together document parsing, classification, extraction, splitting, and retrieval in one place, all wired to a single LlamaParse API credential🦙 Each resource can now also act as a callable tool inside an n8n AI Agent: so instead of building static pipelines, you can let the agent decide when to retrieve context, parse a file, or extract structured data based on what the user actually needs🤖 A few workflows worth highlighting: routing documents by type before extracting structured fields, plugging retrieval directly into an agent backed by your own knowledge base, and running parse outputs through different tiers side by side to find the right balance between accuracy and cost🔃 If you're already using n8n, install it directly from your workflow canvas by searching 𝘓𝘭𝘢𝘮𝘢𝘗𝘢𝘳𝘴𝘦 𝘗𝘭𝘢𝘵𝘧𝘰𝘳𝘮 and give it a try!🔧 📚️ Full breakdown in our blog post: https://www.llamaindex.ai/blog/bring-your-document-workflows-to-n8n-with-the-llamaparse-node?utm_medium=socials&utm_source=twitter&utm_campaign=2026-jun-

RT Gergely Orosz Catch me + five epic and extremely hands-on AI founders on Tuesday (30 June) - @ankrgyl, @jerryjliu0, @Sirupsen, @bernhardsson & @travers00 It just so happens to be smack in the middle of an AI pickleball tournament. Yes it's very SF! Register here: https://luma.com/the-agent-open

RT LlamaIndex 🦙 We built LiteParse, the fastest document parsing solution on the planet and made it open source. And it just hit 10k github stars. 🦙 Fast to run. Fast to love. Thanks for building with us. If you haven't tried it already, repo at: https://github.com/run-llama/liteparse?utm_medium=socials&utm_source=twitter_li&utm_campaign=2026-06

Unlimited OCR is a great model on table parsing and understanding proper reading order. However it does struggle a little on semantic formatting, charts (it does decent at bounding boxes). Attaching the results below to compare against PaddleOCR-VL-1.6. Overall it's still a great addition to the open-weight OCR model collection! Check the latest results on ParseBench: https://www.parsebench.ai/

We've provided some updated results on Mistral OCR that make use of the annotation feature for charts. The overall score is ahead of GPT-5.5 and just behind Gemini 3.1 Pro, which is quite impressive for a model at its price range. It does a great job on content faithfulness, semantic formatting, and visual grounding. It does an ok job on tables and an ok job (though to be fair, non-zero) on charts. There's been some great advancements on visual understanding capabilities lately. See screenshot below for performance, will update the main benchmark page soon: https://www.parsebench.ai/

RT Clelia Bertelli (🦙/acc) I decided to run my knowledge base inside a @Cloudflare Worker👀 How? Surprisingly easily: • Spin up a @qdrant_engine cluster and grab the credentials • Process incoming files at the edge: parse with @llama_index LiteParse and chunk with @ChonkieAI’s chunking library, both running on WASM • Store file contents in a Durable Object • Embed chunks directly in Qdrant using its built-in inference (pretty neat, right?) But the Worker doesn’t just handle ingestion: it can also retrieve information from your knowledge base, read files from Durable Object storage, and grep through them on demand. I deploy it in a single click and connect it to my coding agents via local stdio MCP, running 𝘯𝘱𝘹 -𝘺 @𝘤𝘭𝘦-𝘥𝘰𝘦𝘴-𝘵𝘩𝘪𝘯𝘨𝘴/𝘸𝘰𝘳𝘬𝘦𝘳𝘣𝘢𝘴𝘦-𝘮𝘤𝘱. Deploy your own now (works with free plans!) → http://github.com/AstraBert/workerbase

RT Niels Rogge ParseBench is now also available on Papers with Code! Find it here: https://paperswithcode.co/benchmark/parsebench

RT simon Changing all our pitch decks to quality, quality, quality cc @jerryjliu0

We benchmarked Mistral OCR against other frontier and open-weight models on ParseBench 📊 For a model at its price point, it is quite competitive! - It wins on semantic formatting - understanding strikethroughs, superscripts/subscripts, title hierarchy, links - It is competitive on content faithfulness (reading order + hallucinations + omissions) and visual grounding (bounding boxes) - It does ok on tables and doesn't really have chart capabilities. Of course, some of the frontier models + OCR providers like Azure Doc Intelligence + AWS Textract are a bit more expensive. Check out our full leaderboard on ParseBench: https://www.parsebench.ai/

RT Parallel Web Systems Join us Tuesday, June 30th, for the inaugural Agent Open pickleball tournament! 🏟️ Our co-founder, @travers00, will join leaders from @Pragmatic_Eng, @braintrust, @llama_index, @turbopuffer, and @modal for a panel on the state of AI. First-come, first-served: https://luma.com/the-agent-open?utm_source=parallel

This is a reminder that we are co-hosting a massive pickleball tournament 🏓 next Tuesday June 30th, as folks are in town for the @aiDotEngineer World Fair. Come check it out! https://luma.com/the-agent-open

RT LlamaIndex 🦙 Bring your hot takes and your drop shots.🔥 Next week, we're co-hosting The Agent Open: an afternoon of pickleball, food, drinks, and industry-leading speakers who ace their code and commit to their serves. 🏓 Catch our co-founder and CEO, Jerry Liu after Day 2 of AIE World's Fair on a panel moderated by Gergely Orosz (𝘛𝘩𝘦 𝘗𝘳𝘢𝘨𝘮𝘢𝘵𝘪𝘤 𝘌𝘯𝘨𝘪𝘯𝘦𝘦𝘳). Get ready for a real conversation about the Future of AI and learn how to avoid the hype, stay out of the kitchen, and strategically position your team for what's next. 🗓️ Tuesday, June 30th @ 5:00pm PT 📍 San Francisco (register for the address) 🦙 Co-hosted by LlamaIndex with Braintrust, turbopuffer, Cursor, Parallel Web Systems, Modal, and Browserbase Come for the panel, stay for the championship rounds. RSVP: https://luma.com/the-agent-open?utm_source=llamaindex&utm_medium=socials&utm_campaign=2026-06 #AIEngineering #AIAgents #DocumentAI

RT Afiz ⚡️ Re @jerryjliu0 I also built a fullstack PDF parser using LiteParse, which is super fast. https://x.com/itsafiz/status/2068647234691026970

We parsed this SpaceX equity research PDF faster than the time it took for Screen Studio to zoom in ⚡️🔥 liteparse is now the best open-source document parsing tool out there. There’s no reason to not use it as a first pass, even if you do have docs that require heavier VLM processing downstream. Try it out now over any document: https://www.llamaindex.ai/liteparse-demo Repo: https://github.com/run-llama/liteparse

RT Clelia Bertelli (🦙/acc) Convert almost anything to PDF with http://pdfitdown.app! I recently released PdfItDown v3, the library I built to convert most file formats to PDF. Now it has a full-stack web app too :) The frontend is built with @tan_stack and deployed on a @Cloudflare Worker, with @WorkOS handling authentication and @posthog powering analytics🌐 The backend runs on @FastAPI, deployed as a @Docker image on @Railway. It uses @upstash Redis for rate limiting and @opentelemetry + @AxiomFM for observability, while @llama_index LiteParse handles the markdown conversion step🛠️ As always, it’s fully OSS and self-hostable: http://github.com/AstraBert/pdfitdown-app 😉 Leave a little ⭐ to PdfItDown as well: http://github.com/AstraBert/PdfItDown