Show HN: Drop-in SQS replacement based on SQLite
487 by memset | 122 comments on Hacker News.
Hi! I wanted to share an open source API-compatible replacement for SQS. It's written in Go, distributes as a single binary, and uses SQLite for underlying storage. I wrote this because I wanted a queue with all the bells and whistles - searching, scheduling into the future, observability, and rate limiting - all the things that many modern task queue systems have. But I didn't want to rewrite my app, which was already using SQS. And I was frustrated that many of the best solutions out there (BullMQ, Oban, Sidekiq) were language-specific. So I made an SQS-compatible replacement. All you have to do is replace the endpoint using AWS' native library in your language of choice. For example, the queue works with Celery - you just change the connection string. From there, you can see all of your messages and their status, which is hard today in the SQS console (and flower doesn't support SQS.) It is written to be pluggable. The queue implementation uses SQLite, but I've been experimenting with RocksDB as a backend and you could even write one that uses Postgres. Similarly, you could implement multiple protocols (AMQP, PubSub, etc) on top of the underlying queue. I started with SQS because it is simple and I use it a lot. It is written to be as easy to deploy as possible - a single go binary. I'm working on adding distributed and autoscale functionality as the next layer. Today I have search, observability (via prometheus), unlimited message sizes, and the ability to schedule messages arbitrarily in the future. In terms of monetization, the goal is to just have a hosted queue system. I believe this can be cheaper than SQS without sacrificing performance. Just as Backblaze and Minio have had success competing in the S3 space, I wanted to take a crack at queues. I'd love your feedback!
Top Menu
▼
Main Menu
▼
▼
Sunday, June 30, 2024
New best story on Hacker News: Show HN: I am building an open-source Confluence and Notion alternative
Show HN: I am building an open-source Confluence and Notion alternative
499 by Pi9h | 196 comments on Hacker News.
Hello HN, I am building Docmost, an open-source collaborative wiki and documentation software. It is an open-source alternative to Confluence and Notion. I have been working on it for the past 12 months. This is the first public release (beta). The rich-text editor has support for real-time collaboration, LaTex, inline comments, tables, and callouts to name a few. Features - Collaborative real-time editor - Spaces (Teamspace) - User permissions - Groups - Comments - Page history - Nested pages - Search - File attachments You can find screenshots of the product on the website. Website: https://docmost.com Github: https://ift.tt/R6hosKw Documentation: https://ift.tt/4FIPEi9 I would love to hear your feedback. Thank you.
499 by Pi9h | 196 comments on Hacker News.
Hello HN, I am building Docmost, an open-source collaborative wiki and documentation software. It is an open-source alternative to Confluence and Notion. I have been working on it for the past 12 months. This is the first public release (beta). The rich-text editor has support for real-time collaboration, LaTex, inline comments, tables, and callouts to name a few. Features - Collaborative real-time editor - Spaces (Teamspace) - User permissions - Groups - Comments - Page history - Nested pages - Search - File attachments You can find screenshots of the product on the website. Website: https://docmost.com Github: https://ift.tt/R6hosKw Documentation: https://ift.tt/4FIPEi9 I would love to hear your feedback. Thank you.
Saturday, June 29, 2024
New best story on Hacker News: Ask HN: What is the best code base you ever worked on?
Ask HN: What is the best code base you ever worked on?
501 by pcatach | 419 comments on Hacker News.
And what made it so good? Was there someone enforcing good practices top down? Just being in a group of great engineers? Or something else?
501 by pcatach | 419 comments on Hacker News.
And what made it so good? Was there someone enforcing good practices top down? Just being in a group of great engineers? Or something else?
Friday, June 28, 2024
Thursday, June 27, 2024
Wednesday, June 26, 2024
Tuesday, June 25, 2024
Monday, June 24, 2024
New best story on Hacker News: Microfeatures I love in blogs and personal websites
Microfeatures I love in blogs and personal websites
742 by fabianholzer | 320 comments on Hacker News.
742 by fabianholzer | 320 comments on Hacker News.
New best story on Hacker News: The tiny chip that powers Montreal subway tickets
The tiny chip that powers Montreal subway tickets
666 by todsacerdoti | 337 comments on Hacker News.
666 by todsacerdoti | 337 comments on Hacker News.
Sunday, June 23, 2024
Saturday, June 22, 2024
Friday, June 21, 2024
Thursday, June 20, 2024
New best story on Hacker News: Show HN: I made a puzzle game that gently introduces my favorite math mysteries
Show HN: I made a puzzle game that gently introduces my favorite math mysteries
633 by MCSP | 124 comments on Hacker News.
This is the first iteration of a short game I’m making that tries to interactively explain some of my favorite math questions / ideas. My goal is mostly to get the player curious and not necessarily to explain absolutely everything. There were a lot of fun technical parts to building this: - For implementation reasons, it’s much easier if the lines all have integer intersection points with each other. To do this, when a new line is added I “cheat” by rounding intersections to integers and then splitting the old lines at the intersection into new linds (with potentially different slopes) going through the rounded point - I had to draw semi accurate maps of actual places (UK, South America, US west coast) in the HTML canvas using just line segments. I tried a few different solutions, including using SVG data. I ended up using the topojson library to give nice line approximations to GeoJSON maps - I use a simple backtracking algorithm to handle the live coloring of graphs - I use turf.js’s polygonize function to handle finding polygons from line segments (very happy I didn’t have to implement this myself!) - I wanted to make the game as mobile friendly as possible (don’t think I’ve nailed this quite yet) There were also a few tradeoffs I made: - I wanted give links earlier in the game for players to learn more, but I decided to wait until the end to maintain the flow of the game - In order to make the game more mobile-friendly, I generally stuck to maps with a small number of regions (at least for maps people have to interact with them). So for the most part all of the instances in the game are “easy”
633 by MCSP | 124 comments on Hacker News.
This is the first iteration of a short game I’m making that tries to interactively explain some of my favorite math questions / ideas. My goal is mostly to get the player curious and not necessarily to explain absolutely everything. There were a lot of fun technical parts to building this: - For implementation reasons, it’s much easier if the lines all have integer intersection points with each other. To do this, when a new line is added I “cheat” by rounding intersections to integers and then splitting the old lines at the intersection into new linds (with potentially different slopes) going through the rounded point - I had to draw semi accurate maps of actual places (UK, South America, US west coast) in the HTML canvas using just line segments. I tried a few different solutions, including using SVG data. I ended up using the topojson library to give nice line approximations to GeoJSON maps - I use a simple backtracking algorithm to handle the live coloring of graphs - I use turf.js’s polygonize function to handle finding polygons from line segments (very happy I didn’t have to implement this myself!) - I wanted to make the game as mobile friendly as possible (don’t think I’ve nailed this quite yet) There were also a few tradeoffs I made: - I wanted give links earlier in the game for players to learn more, but I decided to wait until the end to maintain the flow of the game - In order to make the game more mobile-friendly, I generally stuck to maps with a small number of regions (at least for maps people have to interact with them). So for the most part all of the instances in the game are “easy”
Wednesday, June 19, 2024
Tuesday, June 18, 2024
Monday, June 17, 2024
New best story on Hacker News: FTC sues Adobe for hiding fees and inhibiting cancellations
FTC sues Adobe for hiding fees and inhibiting cancellations
670 by ChrisArchitect | 271 comments on Hacker News.
670 by ChrisArchitect | 271 comments on Hacker News.
Sunday, June 16, 2024
New best story on Hacker News: What You Get After Running an SSH Honeypot for 30 Days
What You Get After Running an SSH Honeypot for 30 Days
481 by SofianeHamlaoui | 325 comments on Hacker News.
481 by SofianeHamlaoui | 325 comments on Hacker News.
New best story on Hacker News: Show HN: We Made The World's Smallest and Cheapest Network Switch
Show HN: We Made The World's Smallest and Cheapest Network Switch
510 by Hello9999901 | 141 comments on Hacker News.
Hello, we're Max and Byran from MUREX Robotics, a high school robotics team from Exeter, New Hampshire. We are super proud to have made this open source piece of technology! It is only 6.9 dollars (actually!) from JLCPCB :) I hope you like it. You can find us at byran@mrx.ee and max@mrx.ee as well if you have any questions. We will be putting a small run of these boards for sale somewhere (we have <25 units of stock), probably for $10+shipping. Let us know if you're interested in more! Board files for everything we make is here: https://github.com/murexrobotics/electrical-2024
510 by Hello9999901 | 141 comments on Hacker News.
Hello, we're Max and Byran from MUREX Robotics, a high school robotics team from Exeter, New Hampshire. We are super proud to have made this open source piece of technology! It is only 6.9 dollars (actually!) from JLCPCB :) I hope you like it. You can find us at byran@mrx.ee and max@mrx.ee as well if you have any questions. We will be putting a small run of these boards for sale somewhere (we have <25 units of stock), probably for $10+shipping. Let us know if you're interested in more! Board files for everything we make is here: https://github.com/murexrobotics/electrical-2024
Saturday, June 15, 2024
Friday, June 14, 2024
Thursday, June 13, 2024
New best story on Hacker News: Microsoft Chose Profit over Security, Whistleblower Says
Microsoft Chose Profit over Security, Whistleblower Says
493 by tyleroconnell | 245 comments on Hacker News.
493 by tyleroconnell | 245 comments on Hacker News.
Wednesday, June 12, 2024
New best story on Hacker News: ARC Prize – a $1M+ competition towards open AGI progress
ARC Prize – a $1M+ competition towards open AGI progress
451 by mikeknoop | 204 comments on Hacker News.
Hey folks! Mike here. Francois Chollet and I are launching ARC Prize, a public competition to beat and open-source the solution to the ARC-AGI eval. ARC-AGI is (to our knowledge) the only eval which measures AGI: a system that can efficiently acquire new skill and solve novel, open-ended problems. Most AI evals measure skill directly vs the acquisition of new skill. Francois created the eval in 2019, SOTA was 20% at inception, SOTA today is only 34%. Humans score 85-100%. 300 teams attempted ARC-AGI last year and several bigger labs have attempted it. While most other skill-based evals have rapidly saturated to human-level, ARC-AGI was designed to resist “memorization” techniques (eg. LLMs) Solving ARC-AGI tasks is quite easy for humans (even children) but impossible for modern AI. You can try ARC-AGI tasks yourself here: https://ift.tt/koSQRzp ARC-AGI consists of 400 public training tasks, 400 public test tasks, and 100 secret test tasks. Every task is novel. SOTA is measured against the secret test set which adds to the robustness of the eval. Solving ARC-AGI tasks requires no world knowledge, no understanding of language. Instead each puzzle requires a small set of “core knowledge priors” (goal directedness, objectness, symmetry, rotation, etc.) At minimum, a solution to ARC-AGI opens up a completely new programming paradigm where programs can perfectly and reliably generalize from an arbitrary set of priors. At maximum, unlocks the tech tree towards AGI. Our goal with this competition is: 1. Increase the number of researchers working on frontier AGI research (vs tinkering with LLMs). We need new ideas and the solution is likely to come from an outsider! 2. Establish a popular, objective measure of AGI progress that the public can use to understand how close we are to AGI (or not). Every new SOTA score will be published here: https://x.com/arcprize 3. Beat ARC-AGI and learn something new about the nature of intelligence. Happy to answer questions!
451 by mikeknoop | 204 comments on Hacker News.
Hey folks! Mike here. Francois Chollet and I are launching ARC Prize, a public competition to beat and open-source the solution to the ARC-AGI eval. ARC-AGI is (to our knowledge) the only eval which measures AGI: a system that can efficiently acquire new skill and solve novel, open-ended problems. Most AI evals measure skill directly vs the acquisition of new skill. Francois created the eval in 2019, SOTA was 20% at inception, SOTA today is only 34%. Humans score 85-100%. 300 teams attempted ARC-AGI last year and several bigger labs have attempted it. While most other skill-based evals have rapidly saturated to human-level, ARC-AGI was designed to resist “memorization” techniques (eg. LLMs) Solving ARC-AGI tasks is quite easy for humans (even children) but impossible for modern AI. You can try ARC-AGI tasks yourself here: https://ift.tt/koSQRzp ARC-AGI consists of 400 public training tasks, 400 public test tasks, and 100 secret test tasks. Every task is novel. SOTA is measured against the secret test set which adds to the robustness of the eval. Solving ARC-AGI tasks requires no world knowledge, no understanding of language. Instead each puzzle requires a small set of “core knowledge priors” (goal directedness, objectness, symmetry, rotation, etc.) At minimum, a solution to ARC-AGI opens up a completely new programming paradigm where programs can perfectly and reliably generalize from an arbitrary set of priors. At maximum, unlocks the tech tree towards AGI. Our goal with this competition is: 1. Increase the number of researchers working on frontier AGI research (vs tinkering with LLMs). We need new ideas and the solution is likely to come from an outsider! 2. Establish a popular, objective measure of AGI progress that the public can use to understand how close we are to AGI (or not). Every new SOTA score will be published here: https://x.com/arcprize 3. Beat ARC-AGI and learn something new about the nature of intelligence. Happy to answer questions!
Tuesday, June 11, 2024
Monday, June 10, 2024
Sunday, June 9, 2024
Saturday, June 8, 2024
Friday, June 7, 2024
Thursday, June 6, 2024
Wednesday, June 5, 2024
Tuesday, June 4, 2024
Monday, June 3, 2024
Sunday, June 2, 2024
Saturday, June 1, 2024
New best story on Hacker News: Show HN: Every mountain, building and tree shadow mapped for any date and time
Show HN: Every mountain, building and tree shadow mapped for any date and time
612 by tppiotrowski | 180 comments on Hacker News.
I've been working on this project for about 4 years. It began as terrain only because world wide elevation data was publicly available. I then added buildings from OpenStreetMap (crowd sourced) and more recently from Overture Maps data. Some computer vision/machine learning advancements [1] in the past few years have made it possible to estimate tree canopy heights using satellite imagery alone making it possible to finally add trees to the map. The data isn't perfect, but it's within +/- 3 meters of so. Good enough to give a general idea for any location on Earth. Happy to answer any questions. [1] https://ift.tt/CANlqZ1
612 by tppiotrowski | 180 comments on Hacker News.
I've been working on this project for about 4 years. It began as terrain only because world wide elevation data was publicly available. I then added buildings from OpenStreetMap (crowd sourced) and more recently from Overture Maps data. Some computer vision/machine learning advancements [1] in the past few years have made it possible to estimate tree canopy heights using satellite imagery alone making it possible to finally add trees to the map. The data isn't perfect, but it's within +/- 3 meters of so. Good enough to give a general idea for any location on Earth. Happy to answer any questions. [1] https://ift.tt/CANlqZ1