HNHacker News
TopNewBestAskShowJobs

sergiishcherbak

7 karma · joined June 6, 2023

submissionscomments
sergiishcherbak··on Tethered – Runtime network egress control for Python
I've just published tethered, a Python package for runtime network egress control, which is dependency-free, zero-infrastructure, and very easy to set up. It takes one function call to restrict which hosts your code can connect to.

Use cases: - Supply chain defense. A compromised dependency can't phone home if egress is locked to your known services. - AI agent guardrails. Constrain LLM-powered agents to only the APIs they need. - Test isolation. Ensure your test suite never accidentally hits production endpoints. - Least-privilege networking. Declare your app's network surface the same way you declare its dependencies.

github.com/shcherbak-ai/tethered

sergiishcherbak··on Transform DOCX into LLM-ready data
As part of work on my open-source project ContextGem, I've built a native, zero-dependency DOCX converter that transforms Word documents into LLM-ready data.

This custom-built converter directly processes Word XML, provides comprehensive content extraction + covers what other open-source tools often miss or lack support for:

- Rich paragraph and sentence metadata for enhanced context

- Misaligned tables

- Comments, footnotes, and textboxes

- Embedded images

The converted document can then be easily used in ContextGem's LLM extraction workflows.

Perfect for developers building contract intelligence applications where precision matters. The converter preserves document structure and relationships, empowering LLMs to better understand and analyze document content.

Try it / share with your dev team today and see the difference in your document processing pipeline!

GitHub: https://github.com/shcherbak-ai/contextgem

All DocxConverter features: https://contextgem.dev/converters/docx.html

sergiishcherbak··on ContextGem: Easier and faster way to build LLM extraction workflows
I have just released ContextGem - an open-source Python framework that offers the easiest and fastest way to build LLM extraction workflows through powerful abstractions.

Why ContextGem? Most popular LLM frameworks for extracting structured data from documents require extensive boilerplate code to extract even basic information. This significantly increases development time and complexity.

ContextGem addresses this challenge by providing a flexible, intuitive framework that extracts structured data and insights from documents with minimal effort. Complex, most time-consuming parts, - prompt engineering, data modelling and validators, grouped LLMs with role-specific tasks, neural segmentation, etc. - are handled with powerful abstractions, eliminating boilerplate code and reducing development overhead.

ContextGem leverages LLMs' long context windows to deliver superior accuracy for data extraction from individual documents. Unlike RAG approaches that often struggle with complex concepts and nuanced insights, ContextGem capitalizes on continuously expanding context capacity, evolving LLM capabilities, and decreasing costs.

Check it out on GitHub: https://github.com/shcherbak-ai/contextgem

If you are a Python developer, please try it! Your feedback would be much appreciated! And if you like the project, please give it a to help it grow. Let's make ContextGem the most effective tool for extracting structured information from documents!