Posts tagged with scaling
After Geocodio unsuccessfully attempted to optimize with ClickHouse alone, they implemented a solution using Kafka for durable storage and Vector for efficient data ingestion.
Read more [www.geocod.io]
Choosing colocation for the infrastructure was the right decision for Ahrefs.
Read more [tech.ahrefs.com]
Join thousands of developers
Every two weeks, I share practical tips, tutorials, and behind-the-scenes insights from maintaining 300+ open source packages.
No spam. Unsubscribe anytime. You can also follow me on X.
A nice intro into using Postgres as your queuing solution, and some nice thoughts abou the importance of scale.
Read more [adriano.fyi]
– www.eloquentarchitecture.com - submitted by John Freeman
We have an export feature that can build an Excel file over the course of many background jobs. Worked beautifully for years. Man, those were the days.
Read more [www.eloquentarchitecture.com]
I'm proud to announce that our team has released a new package called laravel-dynamic-servers.
This package can help start and stop servers when you need them. The prime use case is to spin up extra working servers to help you process the workload on queues.
In this blog post, I'd like to introduce the package to you.
– fly.io
Chris Fidao makes sure that an app feels fast no matter from where you visit it. Fascinating stuff!
Read more [fly.io]
Earlier this week Jason McCreary deployed a feature which automatically spawns new worker servers for Shift based on the job queue workload. This reduced server costs by 97% and wait times by 80%.
Read more [jasonmccreary.me]
– mateusguimaraes.com - submitted by Mateus Guimarães
Learn how I was able to easily scale an application to handle hundreds of millions of jobs using nothing but Laravel, Redis and MySQL
Read more [mateusguimaraes.com]
Here's how Treblle, a large Laravel app, manages to keep their AWS costs low.
Read more [treblle.com]
Jack Ellis shares what happend at his analytics service when one of his clients got viral
Read more [usefathom.com]
My buddy Mattias and I run a monitoring service called Oh Dear! We plan on regularly writing cool stuff on the technical and commericial challenges we face. Here's the first post on how we scale our queues.
Laravel offers a convenient way to create asynchronous background tasks using its queues. We utilize those heavily at Oh Dear! for all our monitoring jobs and in this post we'll share some of our lessons learned and what we consider to be best practices.
Read more [ohdear.app]
Chris Fideo, of Servers For Hackers and Shipping Docker, published a new free video serious on optimizing performance for Laravel apps. He shows how to use the built in artisan commands such as config:cache and route:cache,how to optimize queries, build up good indexes and how to add an object cache in a clean way.
There are some super common reasons your Laravel app might be slow. This course shows you how to avoid speed issues with simple changes you can implement immediately.
https://serversforhackers.com/laravel-perf
Chris is also a working on a paid course on how to scale Laravel apps. If you want to stay in the loop for that one, subscribe to his newsletter.
Elastic Beanstalk is a service by Amazon that can automatically scale an application. Gilbert Pellegrom published a second blogpost in his series on how to get Laravel up and running on the service.
In my last article we decoupled Laravel and got it ready for deployment to the Elastic Beanstalk architecture. However, before we race ahead to actually deploying our code to Elastic Beanstalk we need to do some preparation first. Specifically we need to set up some other AWS services that will be used by our Laravel app. These include:
- Virtual Private Cloud (VPC) to keep our infrastructure secure
- Relational Database Service (RDS) for our MySQL database
- ElastiCache for our Redis cache
With these “supporting” services up and running we can finally move on to deploying our Laravel app to Elastic Beanstalk.