1102
Daily Python News Question, Tips and Tricks, Best Practices on Python Programming Language Find more reddit channels over at @r_channels
Is Flask effective for a production server-sent-events running on a single machine?
@app.route('/stream')
def notifications_stream():
def notifications():
pubsub = redis_conn.pubsub()
pubsub.subscribe("notifications")
for message in pubsub.listen():
yield 'data: {}\n\n'.format(message['data'])
return Response(stream(), content_type="text/event-stream")
If I run a Flask app that contains the route above, among other routes, will it not block the application, let's say, on 1000 requests, even if I run Gunicorn with multi-threaded workers? Assuming 10 workers, each with 10 threads.
I need clarification on the matter to aid in my development.
/r/flask
https://redd.it/1gnylbk
Mega Flask Tutorial - best way to query and display this many-to-many relationship
I'm in a strange situation where as I fixed the issue while typing up this question. However, I'd like to know if my solution can be improved.
I've just completed the Followers section and part of the Pagination section of the Flask Mega Tutorial.
In addition to Users, Posts and followers, I've also added Tags. Each post can have multiple tags (many-to-many relationship). I've bridged Posts & Tags with a post_tag association table that contains the foreign keys Tag.id and Post.id.
To display the tags for each post, I have a method called get_tags() in Post. Let's say the page can display up to 20 posts per page (for development purposes, this is currently set to 3). For each post, I therefore query the database once for the tags with get_tags() and this doesn't sound very efficient (here's the visual if it helps). Is this considered bad, what's the usual way of getting posts and its associated tags?
I have pages which display only posts by one user and pages which can display posts from different users.
Here's are the relevant models from models.py (and sorry if the identation is wildly bad - I'm having some issue with VSCode where it won't let me indent
/r/flask
https://redd.it/1gnjt8x
Beating the Dino Game with ML
# What My Project Does
Beats the dinosaur game with AI
# Target Audience
Not meant for any real life usage. Mainly just a side project, and hopefully a nice resource for someone trying to do something similar.
# Comparison
Performs quite poorly when compared to other libraries out there like TensorFlow.
# Other Details
Made with python from scratch(no ML libraries) to beat the dinosaur game. More details on my blog: https://matthew-bird.com/blogs/Dino-Game-ML.html
GitHub Repo: https://github.com/mbird1258/Dino-Game
/r/Python
https://redd.it/1gnakqp
Introducing screenman, a tool to setup the screen layout depending on the connected screens
My first attempt at a python package: screenman.
# What My Project Does
I was missing a tool that could match screen layout configurations to the connected screens so I decided to write one.
With screenman, I can easily switch between different screen layouts depending on the screens I have connected with a keyboard shortcut.
# Target Audience
Anyone that moves between different, fixed screen setups and wants to easily switch between them.
# Comparison
You can of course do this with xrandr and a shell script, but I wanted something that I can map to a single keybinding.
Any feedback is welcome!
GitHub repo: https://github.com/Jimmy2027/screenman
/r/Python
https://redd.it/1gngim6
Sunday Daily Thread: What's everyone working on this week?
# Weekly Thread: What's Everyone Working On This Week? 🛠️
Hello /r/Python! It's time to share what you've been working on! Whether it's a work-in-progress, a completed masterpiece, or just a rough idea, let us know what you're up to!
## How it Works:
1. Show & Tell: Share your current projects, completed works, or future ideas.
2. Discuss: Get feedback, find collaborators, or just chat about your project.
3. Inspire: Your project might inspire someone else, just as you might get inspired here.
## Guidelines:
Feel free to include as many details as you'd like. Code snippets, screenshots, and links are all welcome.
Whether it's your job, your hobby, or your passion project, all Python-related work is welcome here.
## Example Shares:
1. Machine Learning Model: Working on a ML model to predict stock prices. Just cracked a 90% accuracy rate!
2. Web Scraping: Built a script to scrape and analyze news articles. It's helped me understand media bias better.
3. Automation: Automated my home lighting with Python and Raspberry Pi. My life has never been easier!
Let's build and grow together! Share your journey and learn from others. Happy coding! 🌟
/r/Python
https://redd.it/1gnnmv7
Separating music into notes and instruments (audio source separation)
# What My Project Does
A basic program I made to turn music into sheet music(almost). Works by recreating the Fourier transform of the music by adding together the Fourier transforms of instrument samples and comparing the envelope of the instruments to the note being played. More details on my blog: matthew-bird.com/blogs/Audio-Decomposition.html
# Target Audience
Not meant for any real life usage. Mainly just a side project, and hopefully a nice resource for someone trying to do something similar. Might also be useful for music transcription.
# Comparison
Compared to other methods out there, I think this project holds up pretty well. Most sites on the internet also seem to use AI instead of a blind source separation algorithm.
# Other Details
Instrument samples from University of Iowa Electronic Music Studios: https://theremin.music.uiowa.edu/mis.html
GitHub Repo: https://github.com/mbird1258/Audio-Decomposition
/r/Python
https://redd.it/1gnajj6
DRF + React setup
Hi folks, im about to start my first DRF api project with a React frontend. I like to deploy early, so just thinking about how to engineer the two.
Ill be using Railway. So do i push my backend api (with cors and settings done etc ) to one repo and then deploy that to one Railway container?
The push my React frontend to another repo/railway container, and use the URL of my api container to make calls to the api?
This is what ive done with React/Pocketbase in the past.
/r/djangolearning
https://redd.it/1gmnuy3
Best way to generate a single page PDF using selected items from current page in MkDocs
Let's say i have a page in MkDocs that has a several paragraphs of text together with a checklist.
I now want the user to be able to click a button, and generate a PDF with just the checklist on it. I do not want the paragraphs of text to print, and I want to be able to control how the checklist looks on paper vs the screen (e.g. change font font size).
Is there a tool or plug-in that would be suitable for this type of use case?
Thank you!
/r/django
https://redd.it/1gmusyz
Flask app returning 404 bad request for body with "\"
400 Bad Request: The browser (or proxy) sent a request that this server could not understand.
So, on the flask app I am working on, I need to send the body like {"msg":"\\ hi"}.
This returns an issue:
. Can anybody explain why this happens and what is the solution?
/r/flask
https://redd.it/1gmgc5g
Saturday Daily Thread: Resource Request and Sharing! Daily Thread
# Weekly Thread: Resource Request and Sharing 📚
Stumbled upon a useful Python resource? Or are you looking for a guide on a specific topic? Welcome to the Resource Request and Sharing thread!
## How it Works:
1. Request: Can't find a resource on a particular topic? Ask here!
2. Share: Found something useful? Share it with the community.
3. Review: Give or get opinions on Python resources you've used.
## Guidelines:
Please include the type of resource (e.g., book, video, article) and the topic.
Always be respectful when reviewing someone else's shared resource.
## Example Shares:
1. Book: "Fluent Python" \- Great for understanding Pythonic idioms.
2. Video: Python Data Structures \- Excellent overview of Python's built-in data structures.
3. Article: Understanding Python Decorators \- A deep dive into decorators.
## Example Requests:
1. Looking for: Video tutorials on web scraping with Python.
2. Need: Book recommendations for Python machine learning.
Share the knowledge, enrich the community. Happy learning! 🌟
/r/Python
https://redd.it/1gmwz92
How do i test my web app.
I am making an reddit like app in flask. Everything seems fine but i can not think a way to test every views and database. My question is how do you guys test your flask app. Give me some suggestions. Thanks in advance.
/r/flask
https://redd.it/1gml4mx
Choosing a Backend Framework for ML Prediction and Matching
Hey, if you’re going with some ML for prediction and matching—nothing very complicated—and implementing it in a web app, what sort of backend framework should I use, and what workflow should I implement? Usually, I’ve worked with Express.js.
/r/django
https://redd.it/1gme0iv
🎉 Introducing dj-data-generator! 🎉
We’re thrilled to announce the release of dj-data-generator, a new tool designed to simplify generating customizable test data for Django projects. Whether you’re setting up demo environments, populating databases for testing, or running performance tests, dj-data-generator offers efficient, built-in support to meet your needs—all without third-party packages.
Key Features:
\- Generate any number of records for your project models and save them directly to the database with a simple django command
\- Easy customization for model fields
\- Handles unique and related fields
Check it out, and let us know what you think! Feedback, contributions, and suggestions are welcome as we continue to build.
📥 Check it out on PyPI:
https://pypi.org/project/dj-data-generator/
💻 Source Code and Docs on GitHub:
https://github.com/Lazarus-org/dj-data-generator
/r/django
https://redd.it/1gmj9nl
I finally found a currently-maintained version of Whoosh, a text search library
Sygil-Dev/whoosh-reloaded: Whoosh is a fast, featureful full-text indexing and searching library implemented in pure Python.
Whoosh 3.0.0 documentation — Whoosh-Reloaded 3.0.0 documentation
/r/Python
https://redd.it/1gm8ovf
I would like feedback
I am creating an application template for django and I would like to know your opinions, the only condition is that when making django-admin startapp --template=
The app must be created within the django project in a folder called Apps
I leave you the link: https://github.com/simuel/DjangoHexTemplate.git
/r/django
https://redd.it/1gmcbat
D Self-Promotion Thread
Please post your personal projects, startups, product placements, collaboration needs, blogs etc.
Please mention the payment and pricing requirements for products and services.
Please do not post link shorteners, link aggregator websites , or auto-subscribe links.
--
Any abuse of trust will lead to bans.
Encourage others who create new posts for questions to post here instead!
Thread will stay alive until next one so keep posting after the date in the title.
--
Meta: This is an experiment. If the community doesnt like this, we will cancel it. This is to encourage those in the community to promote their work by not spamming the main threads.
/r/MachineLearning
https://redd.it/1gnrb08
Ididi, dependency injection, in a single line of code
Ididi is a pythonic dependency injection lib, with ergonomic apis, without boilplate code, works out of the box.
# What My Project Does
it builds a dependency graph based on your type hints, and inject those dependencies into corresponding classes/functions.
In the base case, all you need to do is to make a call to instance = ididi.solve(class) and you are done.
# Quick Start
Here’s a quick example of how idid works:
import ididi
class Config:
def init(self, env: str = "prod"):
self.env = env
class Database:
def init(self, config: Config):
self.config = config
class UserRepository:
def init(self, db: Database):
self.db = db
class UserService:
def init(self, repo: UserRepository):
/r/Python
https://redd.it/1gn5erp
Open source drone localization
# What My Project Does
Small open source project that performs basic localization using cameras I made as a fun project. Not the most accurate nor fast, but hopefully still a good proof of concept.
# Target Audience
Not meant for any real life usage. Mainly just a side project, and hopefully a nice resource for someone trying to do something similar.
# Comparison
The feature matching in the project is slower than other methods like SIFT, SURF, and ORB, but seems relatively similar in terms of accuracy.
# Other Details
I used raspberry pi 0ws with socket to send images to my computer, where it calculates the relative positioning. Also makes use of ADXL345 accelerometers for rotational invariance. More details including the shopping list on my blog: https://matthew-bird.com/blogs/Drone-Rel-Pos.html
GitHub Repo: https://github.com/mbird1258/Drone-relative-positioning
/r/Python
https://redd.it/1gnagm8
How to find a Django dev cofounder, ?
Hey , Everyone
I am very interested in starting several AI-related projects. LLMs APIs are amazing, and there are numerous B2C applications that can be developed, particularly in fashion or health.—specifically, I’m aiming to build 3 or 4 within a month. I have a background as a Flutter developer +Firebase, but I’m also quite skilled in Django and PostgreSQL. I would love to find a co-founder who shares my passion and is proficient in Django as well. Are there any communities where I can connect with fellow Django developers?
Share ideas, brainstorm ,build fast and monetize it a week?
Honestly, I always had this idea: why don't developers join together to build, monetize quickly, and share the profit?
/r/django
https://redd.it/1gnahbm
How do I maintain consistent web socket connections in my Django app?
I'm developing a Django application that requires a persistent WebSocket connection to continuously fetch live data from a crypto market API. I need to keep this WebSocket connection active throughout the application's lifecycle to update my local data as new information arrives. This updated data will later be displayed on the front end, so I anticipate needing a separate WebSocket connection between the front end and back end (one connection for backend-to-crypto market API, and another for backend-to-frontend).
I'm new to this type of setup and would appreciate guidance on the best practices for implementing it. I've explored Django Channels, Uvicorn, and Daphne. Although Django Channels might be suitable for the frontend-backend WebSocket connection, I'm more focused on maintaining a robust event-loop structure for the backend-to-crypto API connection to ensure it remains alive and responsive. I'm considering building a custom event-loop manager to handle this, but I'm unsure if it's the best approach.
Could you suggest any established methods, libraries, or patterns for maintaining a continuous WebSocket connection for real-time data updates in a Django application?
/r/djangolearning
https://redd.it/1gnj1c8
Freeze Flask and Payment
Hi. I am currently creating static Flask websites and converting them to HTML files using Freeze Flask. I then host the websites on Bunny CDN. I create these websites for clients and one of my clients has requested a system to sell digital products. Does anyone know how I can accept payment?
/r/flask
https://redd.it/1gndsmi
Mesa 3.0: A major update to Python's Agent-Based Modeling library 🎉
Hi everyone! We're very proud to just have released a major update of our Agent-Based Modeling library: [Mesa 3.0](https://github.com/projectmesa/mesa/releases/tag/v3.0.0). It's our biggest release yet, with some really cool improvements to make agent-based modeling more intuitive, flexible and powerful.
## What's Agent-Based Modeling?
Ever wondered how bird flocks organize themselves? Or how traffic jams form? Agent-based modeling (ABM) lets you simulate these complex systems by defining simple rules for individual "agents" (birds, cars, people, etc.) and then watching how they interact. Instead of writing equations to describe the whole system, you model each agent's behavior and let patterns emerge naturally through their interactions. It's particularly powerful for studying systems where individual decisions and interactions drive collective behavior.
## What's Mesa?
Mesa is Python's leading framework for agent-based modeling, providing a comprehensive toolkit for creating, analyzing, and visualizing agent-based models. It combines Python's scientific stack (NumPy, pandas, Matplotlib) with specialized tools for handling spatial relationships, agent scheduling, and data collection. Whether you're studying epidemic spread, market dynamics, or ecological systems, Mesa provides the building blocks to create sophisticated simulations while keeping your code clean and maintainable.
## What's New in 3.0?
The headline feature is the new agent management system, which brings pandas-like functionality to agent handling:
```python
# Find
/r/Python
https://redd.it/1gn5q8z
Project Idea, Is this worth doing?
hi, my name is Joel , I am a uk based software engineer.
I have been working on an idea, using JS and a REST API in Django. the general gist of it is that it is using the canvas and added in functionality to allow users to design a functional webpage where they can choose buttons and redirects make queries and send and receive data, and use stripe to sell subscriptions or products. Basic website stuff. the webapp would include this, but also a team dashboard and hub for people to collaborate and find people who would be interested in making these webpages for business purposes. I'm thinking of letting the custom webpages leverage google maps for increased utility. I also would like to add GPT assistance features for if people want to use them on there custom webpages
Is this all too much for one application? any feedback would be appreciated.
I'm also open to any interested to help me out on what's left of the project, I have no qualms sharing credit or anything thereafter
/r/django
https://redd.it/1gn0b1f
Human Approval Layer to Monitor LLM Agent in Production | Phantasm
Links: [GitHub](https://github.com/phantasmlabs/phantasm) | [PyPI](https://pypi.org/project/phantasmpy/)
**What My Project Does**
Hi everyone!
In the past month or so, I've been building Phantasm. Phantasm offers toolkits to add a human approval layer to monitor LLM agent's workflow in real-time. This allows deployed LLM agent to seek human approvers before executing a certain function.
An example use case for Phantasm:
Let's say, I built an LLM agent that can automatically draft and send email. As an approver, I could make sure that the email content and recipient are correct before the agent actually send the email.
This allows you to build and deploy LLM agent faster as you can monitor their action on the fly.
**Target Audience**
We are still early in development but we have some team we work with to rapidly improve this project to enterprise standard.
The perfect audience for this project would be a small team building an LLM agent.
**Comparison**
* Fully open-source with a custom server and dashboard that you can self-host.
* Comes with a Python SDK for you integrate the approval workflow to your LLM agent.
* Load balancing approval requests to multiple approvers to accomodate growing teams.
If you think this will be helpful for you, feel free to check it out! If you have any feedback
/r/Python
https://redd.it/1gmvfav
I'd like your opinions on how to organize my template files. I've come up with a structure, haven't fully tried it yet. Let me know what you think.
So I've been working with django for a few months now,
and I've been thinking a lot about a good way of organizing my templates and projects.
This is just a thought and I plan to refactor a project or two to see if it meshes well with this,
but here's what I'm thinking: limiting every app's templates to strictly adhere to
the following folder structure.
components
- component_x_folder
- componentx.py
- componentx.js
- componentx.css
- templatex.html
...
includes
- include_x_folder
- includex.html
...
widgets
- [widgetxfolder]
- widgetx.html
...
layouts
- sections
/r/django
https://redd.it/1gmw3cl
A search engine for all your memes (v2.0 updates)
The app is open source 👉 https://github.com/neonwatty/meme\_search
# What My Project Does
The open source engine indexes your memes by their visual content and text, making them easily searchable. Drag and drop recovered memes into any messager.
Addittional features rolling out with the new "pro" version include:
1. Auto-Generate Meme Descriptions: Target specific memes for auto-description generation (instead of applying to your entire directory).
2. Manual Meme Description Editing: Edit or add descriptions manually for better search results, no need to wait for auto-generation if you don't want to.
3. Tags: Create, edit, and assign tags to memes for better organization and search filtering.
4. Faster Vector Search: Powered by Postgres and pgvector, enjoy faster keyword and vector searches with streamlined database transactions.
5. Keyword Search: Pro adds traditional keyword search in addition to semantic/vector search.
6. Directory Paths: Organize your memes across multiple subdirectories—no need to store everything in one folder.
7. New Organizational Tools: Filter by tags, directory paths, and description embeddings, plus toggle between keyword and vector search for more control.
# Target Audience
This is a toy project. Open source and made for fun.
# Comparison
immich: great open source image organizer
other local photo apps: some allow for indexing but not quite
/r/Python
https://redd.it/1gmkv55
Django Tip explaining.only()/.defer() n+1
https://redd.it/1gmo33c
@pythondaily
Feature Friday: The querystring tag!
Today's Feature Friday is about {% querystring %}!
The new {% querystring %} template tag in Django 5.1 makes it easier to access and modify the query string in your Django templates, letting you work with links that use query parameters.
Previously, if you wanted to add or change a single value in the query string, you would need to write a lot of code:
{# Linebreaks added for readability, this should be one, long line. #}
<a href="?{% for key, values in request.GET.iterlists %}
{% if key != "page" %}
{% for value in values %}
{{ key }}={{ value }}&
{% endfor %}
{% endif %}
{% endfor %}page={{ page.nextpagenumber }}">Next page</a>
With {% querystring %} you can replace all of that with this single line:
{% querystring page=http://page.nextpagenumber %}
The {% querystring %} tag is particularly useful for things like filters and pagination—where you want to pass through most of the query parameters but modify one
/r/django
https://redd.it/1gmjgep
Best practice to save some variable in between calls? (no session, no db)
Hello,
I am using Flask to build a desktop app, together with pywebview and other libraries. It's a desktop app, so there will be only one user (it uses the camera, a second screen, tensorflow, opencv, so not something that would be moved to the cloud). I use pywebview to take advantage of the web browser to display a nice interface and use SVG canvas a lot. That's for the context.
Now, there are a lot of internal variables that I track between the different calls to Flask routes. At the beginning I tried to used sessions to record them, but many object are to big in size to store in session, and many are not appropriately serialized to store in cookies (like a keras model for instance). So at the moment, I just store them as global variables, and use the \`global\` keyword here and there to modify their content.
It works fine, but it does not look good. What would be the best practices to store and reuse those variables in my specific case?
Edit: Eventually, I ended up wrapping all those variable in the Flask application variable. Something like this:
```
class Application(Flask):
def __init__(self, *args, **kwargs):
/r/flask
https://redd.it/1gkuggn
Oracle forms builder alternate
Oracle forms builder alternate
Hi All,
My employer recently upgraded from Oracle 11g to 19c..there was a reporting module that was built out of Oracle 6i and now with the upgrade the reporting module is breaking as there is no compatible version of Oracle forms builder with 19c.
So we have been asked to find alternates.I am thinking of suggesting Django with html as the requirement mainly focuses on generating excel docs by querying the Oracle tables.they need an UI component just to trigger the Excel generation process.
Now am from completely java background and have very minimal knowledge in Django.But I did start leaning python and found the file operations are much more clean and minimal code in python when compared to java and hence thinking of suggesting python with Django for a quick turnaround.
Is this good suggestion or Is there anything else out there that am completely missing for this scenario?
Tech stack preferred is java,springboot,angular,python and Django or flask
P.S it has to be open source.When I say open source I mean it should be free of cost
Thanks In advance
/r/Python
https://redd.it/1gm6hp1