14849
Top stories from https://news.ycombinator.com (with 100+ score) Contribute to the development here: https://github.com/phil-r/hackernewsbot Also check https://t.me/designer_news Contacts: @philr
SeleniumBase: Python APIs for web automation and bypassing bot-detection (❄️ Score: 150+ in 2 days)
Link: https://readhacker.news/s/6jCZH
Comments: https://readhacker.news/c/6jCZH
Java in the Small (🔥 Score: 152+ in 2 hours)
Link: https://readhacker.news/s/6jKVK
Comments: https://readhacker.news/c/6jKVK
Show HN: ImPlot3D – A 3D Plotting Library for Dear ImGui (Score: 150+ in 14 hours)
Link: https://readhacker.news/s/6jJ2j
Comments: https://readhacker.news/c/6jJ2j
How we centralized and structured error handling in Golang (Score: 151+ in 18 hours)
Link: https://readhacker.news/s/6jHDL
Comments: https://readhacker.news/c/6jHDL
Cultural Evolution of Cooperation Among LLM Agents (Score: 151+ in 5 hours)
Link: https://readhacker.news/s/6jJEG
Comments: https://readhacker.news/c/6jJEG
1-800-ChatGPT (🔥 Score: 150+ in 56 minutes)
Link: https://readhacker.news/s/6jKx6
Comments: https://readhacker.news/c/6jKx6
Design Token-Based UI Architecture (Score: 152+ in 20 hours)
Link: https://readhacker.news/s/6jH3k
Comments: https://readhacker.news/c/6jH3k
Silver amulet is the oldest evidence of Christianity north of the Alps (Score: 151+ in 8 hours)
Link: https://readhacker.news/s/6jJ2M
Comments: https://readhacker.news/c/6jJ2M
OpenAUTH: Universal, standards-based auth provider (❄️ Score: 150+ in 2 days)
Link: https://readhacker.news/s/6jB63
Comments: https://readhacker.news/c/6jB63
The XOR Texture (2004) (Score: 151+ in 12 hours)
Link: https://readhacker.news/s/6jHr7
Comments: https://readhacker.news/c/6jHr7
Ergo Chat – A modern IRC server written in Go (Score: 150+ in 9 hours)
Link: https://readhacker.news/s/6jHrr
Comments: https://readhacker.news/c/6jHrr
Show HN: I built an open-source data pipeline tool in Go (Score: 150+ in 13 hours)
Link: https://readhacker.news/s/6jG5n
Comments: https://readhacker.news/c/6jG5n
Every data pipeline job I had to tackle required quite a few components to set up:
- One tool to ingest data
- Another one to transform it
- If you wanted to run Python, set up an orchestrator
- If you need to check the data, a data quality tool
Let alone this being hard to set up and taking time, it is also pretty high-maintenance. I had to do a lot of infra work, and while this being billable hours for me I didn’t enjoy the work at all. For some parts of it, there were nice solutions like dbt, but in the end for an end-to-end workflow, it didn’t work. That’s why I decided to build an end-to-end solution that could take care of data ingestion, transformation, and Python stuff. Initially, it was just for our own usage, but in the end, we thought this could be a useful tool for everyone.
In its core, Bruin is a data framework that consists of a CLI application written in Golang, and a VS Code extension that supports it with a local UI.
Bruin supports quite a few stuff:
- Data ingestion using ingestr (https://github.com/bruin-data/ingestr)
- Data transformation in SQL & Python, similar to dbt
- Python env management using uv
- Built-in data quality checks
- Secrets management
- Query validation & SQL parsing
- Built-in templates for common scenarios, e.g. Shopify, Notion, Gorgias, BigQuery, etc
This means that you can write end-to-end pipelines within the same framework and get it running with a single command. You can run it on your own computer, on GitHub Actions, or in an EC2 instance somewhere. Using the templates, you can also have ready-to-go pipelines with modeled data for your data warehouse in seconds.
It includes an open-source VS Code extension as well, which allows working with the data pipelines locally, in a more visual way. The resulting changes are all in code, which means everything is version-controlled regardless, it just adds a nice layer.
Bruin can run SQL, Python, and data ingestion workflows, as well as quality checks. For Python stuff, we use the awesome (and it really is awesome!) uv under the hood, install dependencies in an isolated environment, and install and manage the Python versions locally, all in a cross-platform way. Then in order to manage data uploads to the data warehouse, it uses dlt under the hood to upload the data to the destination. It also uses Arrow’s memory-mapped files to easily access the data between the processes before uploading them to the destination.
We went with Golang because of its speed and strong concurrency primitives, but more importantly, I knew Go better than the other languages available to me and I enjoy writing Go, so there’s also that.
We had a small pool of beta testers for quite some time and I am really excited to launch Bruin CLI to the rest of the world and get feedback from you all. I know it is not often to build data tooling in Go but I believe we found ourselves in a nice spot in terms of features, speed, and stability.
https://github.com/bruin-data/bruin
I’d love to hear your feedback and learn more about how we can make data pipelines easier and better to work with, looking forward to your thoughts!
Best, Burak
Droste’s Lair (Score: 150+ in 1 day)
Link: https://readhacker.news/s/6jDBD
Comments: https://readhacker.news/c/6jDBD
FTC bans hidden junk fees in hotel, event ticket prices (🔥 Score: 165+ in 1 hour)
Link: https://readhacker.news/s/6jGM7
Comments: https://readhacker.news/c/6jGM7
Crunch – a Scheme compiler with a minimal runtime (Score: 150+ in 9 hours)
Link: https://readhacker.news/s/6jFqR
Comments: https://readhacker.news/c/6jFqR
Trying to Recreate iOS on the Web (Score: 150+ in 12 hours)
Link: https://readhacker.news/s/6jJen
Comments: https://readhacker.news/c/6jJen
ISO 8583: The language of credit cards (Score: 150+ in 1 day)
Link: https://readhacker.news/s/6jFVc
Comments: https://readhacker.news/c/6jFVc
Windshield pitting incidents in Washington reach fever pitch on April 15, 1954 (2003) (🔥 Score: 158+ in 1 hour)
Link: https://readhacker.news/s/6jKLp
Comments: https://readhacker.news/c/6jKLp
Updates to H-1B (Score: 150+ in 7 hours)
Link: https://readhacker.news/s/6jJv7
Comments: https://readhacker.news/c/6jJv7
GitHub Copilot is now available for free (🔥 Score: 161+ in 2 hours)
Link: https://readhacker.news/s/6jKrp
Comments: https://readhacker.news/c/6jKrp
The unbearable slowness of being: Why do we live at 10 bits/s? (Score: 151+ in 7 hours)
Link: https://readhacker.news/s/6jJeC
Comments: https://readhacker.news/c/6jJeC
A quick look at OS/2's builtin virtualization (❄️ Score: 150+ in 4 days)
Link: https://readhacker.news/s/6jx9t
Comments: https://readhacker.news/c/6jx9t
Optimizing Ruby's JSON, Part 1 (Score: 151+ in 16 hours)
Link: https://readhacker.news/s/6jHmq
Comments: https://readhacker.news/c/6jHmq
Includeable minimal operating system for C++ (Score: 150+ in 16 hours)
Link: https://readhacker.news/s/6jGVw
Comments: https://readhacker.news/c/6jGVw
Voxon: Real time interactive volumetric holograms (❄️ Score: 150+ in 4 days)
Link: https://readhacker.news/s/6jwKg
Comments: https://readhacker.news/c/6jwKg
The Headlight Brightness Wars (Score: 150+ in 12 hours)
Link: https://readhacker.news/s/6jGfY
Comments: https://readhacker.news/c/6jGfY
Natural Number Game: build the basic theory of the natural numbers from scratch (Score: 150+ in 19 hours)
Link: https://readhacker.news/s/6jFbs
Comments: https://readhacker.news/c/6jFbs
After 3 Years, I Failed. Here's All My Startup's Code (Score: 150+ in 13 hours)
Link: https://readhacker.news/s/6jFsY
Comments: https://readhacker.news/c/6jFsY
3D-Printed Dune Chess Set (❄️ Score: 150+ in 2 days)
Link: https://readhacker.news/s/6jAmA
Comments: https://readhacker.news/c/6jAmA
Microsoft Confirms Password Deletion for 1B Users (❄️ Score: 150+ in 3 days)
Link: https://readhacker.news/s/6jwJD
Comments: https://readhacker.news/c/6jwJD