1102
Daily Python News Question, Tips and Tricks, Best Practices on Python Programming Language Find more reddit channels over at @r_channels
Saturday Daily Thread: Resource Request and Sharing! Daily Thread
# Weekly Thread: Resource Request and Sharing 📚
Stumbled upon a useful Python resource? Or are you looking for a guide on a specific topic? Welcome to the Resource Request and Sharing thread!
## How it Works:
1. Request: Can't find a resource on a particular topic? Ask here!
2. Share: Found something useful? Share it with the community.
3. Review: Give or get opinions on Python resources you've used.
## Guidelines:
Please include the type of resource (e.g., book, video, article) and the topic.
Always be respectful when reviewing someone else's shared resource.
## Example Shares:
1. Book: "Fluent Python" \- Great for understanding Pythonic idioms.
2. Video: Python Data Structures \- Excellent overview of Python's built-in data structures.
3. Article: Understanding Python Decorators \- A deep dive into decorators.
## Example Requests:
1. Looking for: Video tutorials on web scraping with Python.
2. Need: Book recommendations for Python machine learning.
Share the knowledge, enrich the community. Happy learning! 🌟
/r/Python
https://redd.it/1gc8ekm
Pixel-map: A Python CLI tool for plotting geo files in the terminal
# What My Project Does
[**Pixel-map**](https://github.com/RaczeQ/pixel-map) displays geo data in the terminal. It can be used to quickly look into the geospatial data without opening generating HTML maps or using tools like [kepler.gl](https://kepler.gl/).
GitHub: [https://github.com/RaczeQ/pixel-map](https://github.com/RaczeQ/pixel-map)
PyPI: [https://pypi.org/project/pixel-map/](https://pypi.org/project/pixel-map/)
Since I can't embed images in this post, I can only show you the Black and White modes of the library.
ASCII renderer `ascii-bw`:
$ pixel-map arc-de-triomphe.parquet -r ascii-bw --width 82 --height 43 --no-bg
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━ arc-de-triomphe.parquet ━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ ┃
┃ ┃
┃ @@L_ jr
/r/Python
https://redd.it/1gc3a1k
Posting 2 - the HTTP client TUI, now supports Python scripting, custom keymaps, and more!
Hello r/Python
I'm excited to share Posting 2 with you all!
# What My Project Does
Posting is a terminal based app for interacting with HTTP APIs. It's a bit like Postman, Insomnia, Bruno, etc.
Posting is a snappy and keyboard-centric UI, built for power users but still approachable for those who aren't familiar with terminal apps.
You can build up requests using the UI, send them and interact with the response, and save the requests to disk as simple YAML files for easy sharing, version control, and re-use.
Posting offers efficient "jump mode" navigation which allows you to jump across the UI quickly with the keyboard, extensive autocompletion, themes, integration with other tools (e.g. quickly swap into Vim to edit a request body and swap back), and a bunch more quality-of-life features to let you move fast.
It's written entirely in Python using the Textual framework, and also uses great Python tools like httpx and Pydantic.
With the new release of version 2, you can now run Python code before and after requests! This lets you perform setup and teardown (e.g. logging, setting variables, tokens, etc.).
This version also introduces the (frequently requested) ability to change your keymap for a variety of actions. This will hopefully prevent keybind
/r/Python
https://redd.it/1gc0tiu
[R] Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss
https://arxiv.org/abs/2410.17243
/r/MachineLearning
https://redd.it/1gbvapp
Help Needed: Scaling My RAG-Based LLM Browser Extension
Hi everyone,
I've developed a browser extension using a Retrieval-Augmented Generation (RAG) model that works great with PDF files stored locally on my machine, with server running on flask. Now, I’m looking to scale this solution for broader use and could really use some advice from experts here as I’m new to deployment.
Here are my key questions:
1. Secured Authorization System: What’s the best approach to create a secure authorization system that adheres to modern security standards?
2. Secure Data Storage: I plan to let users upload their data (primarily PDFs for now). This data needs to be encrypted and protected against security threats. What’s the recommended way to store this data securely while keeping these threats in mind?
3. Affordable LLM Service: (Not a priority but still relevant) Right now, I’m using the gemini-1.5-flash API with my own key. I’m looking for suggestions on any free or low-cost LLM services I can use at scale.
Any insights, advice, or pointers would be greatly appreciated! Thanks in advance!
/r/flask
https://redd.it/1gav6h7
Manim : package for maths animation
I recently explored Manim, an open-sourced python package for generating animated videos for explaining maths. It includes animations for shapes, equations, codes, graphs, etc. The repo is trending on GitHub as well. The demo also looks very impressive. Check it out here : https://youtu.be/QciJxVjF4M4?si=Bk_gU4Tj5f6gPpiq
/r/Python
https://redd.it/1gbldgk
Ethics concerns and Google D
Apologies if this isn't the right place for this facet of ML, but it didn't seem against the rules.
I recently participated in an Alphabet human data research study used to evaluate AI agents and models.
Without going further into the details, the structure of the study felt very ethically questionable. The agreement said if there were any concerns, to contact HuBREC, human behavioural research ethics committee.
However, their email provided in the agreement hubrec@google.com does not exist and I have no point of contact at all short of looking up past academic talks and cold emailing people.
I am having a lot of difficulty searching for next steps as there is no other contact information I can use except for that email. I do know that Google has fired AI ethics researchers in recent memory, and that this topic never seems to be taken seriously. It seems like a bad look for an on-going study to point you to a committee that doesn't seem to exist.
/r/MachineLearning
https://redd.it/1gbblsc
Friday Daily Thread: r/Python Meta and Free-Talk Fridays
# Weekly Thread: Meta Discussions and Free Talk Friday 🎙️
Welcome to Free Talk Friday on /r/Python! This is the place to discuss the r/Python community (meta discussions), Python news, projects, or anything else Python-related!
## How it Works:
1. Open Mic: Share your thoughts, questions, or anything you'd like related to Python or the community.
2. Community Pulse: Discuss what you feel is working well or what could be improved in the /r/python community.
3. News & Updates: Keep up-to-date with the latest in Python and share any news you find interesting.
## Guidelines:
All topics should be related to Python or the /r/python community.
Be respectful and follow Reddit's Code of Conduct.
## Example Topics:
1. New Python Release: What do you think about the new features in Python 3.11?
2. Community Events: Any Python meetups or webinars coming up?
3. Learning Resources: Found a great Python tutorial? Share it here!
4. Job Market: How has Python impacted your career?
5. Hot Takes: Got a controversial Python opinion? Let's hear it!
6. Community Ideas: Something you'd like to see us do? tell us.
Let's keep the conversation going. Happy discussing! 🌟
/r/Python
https://redd.it/1gbh5k3
jinja template rendering incorrect
Anyone know why jinja template statements would get borked while being rendered?
I have a couple of if statements in my config ie:
\## template: jinja
{% if distro == 'rocky' or distro == 'centos' or distro == 'ol' or distro == 'almalinux' or distro == 'fedora' or distro == 'redhat' %}
Is rendered as:
{0 if distro == 'rocky' or distro == 'centos' or distro == 'ol' or distro == 'almalinux' or distro == 'fedora' or distro == 'redhat' 0}
I do not know what process renders the jinja code, it was working then one day I started noticing all {% show up as {0 and making it where jinja can't process the variables.
Thanks
/r/Python
https://redd.it/1gbge2q
The amazing architect strikes
/r/django
https://redd.it/1gb33yy
Hatch or uv for a new project?
I'm starting a new project, and I can't decide if hatch is needed anymore.
Hatch can install packages using uv for speed, so I used both before.
But uv allows monorepo, while hatch doesn't support it yet.
What are the differences between the two tools ? What would you choose for a new project?
/r/Python
https://redd.it/1gaz3tm
Help with Creating a Seat Model Linked to Backend in Bus Booking App
Hi all,
I’m working on a Django project for a bus booking system. I’ve already created the Agency and Bus models, but I’m stuck on how to implement the seat structure. Here’s what I’m aiming for:
• I want to create a Seat model that is linked to a Bus, which in turn is associated with an Agency.
• On the frontend, I want to display the seats as they appear in an actual bus (for example, in a 2x2 seating arrangement or other layouts).
• The seats need to be generated dynamically based on the bus assigned.
Could someone guide me on the best way to structure the Seat model and how to display the seats in the view? Any help on connecting these models and ensuring the seats are linked correctly to each bus would be appreciated!
Thanks in advance!
/r/djangolearning
https://redd.it/1gak7t8
Project World's first autonomous AI-discovered 0-day vulnerabilities
I'm sure a lot of people have found 0-day vulnerabilities by pasting code snippets into ChatGPT. The problem has always been scanning an entire project for 0-days. Some papers have shown it's possible by feeding their agents known vulnerable code, but as far as I know, none of those papers ever got any CVEs or found real 0-days. Vulnhuntr was released this weekend with more than a dozen 0-days discovered in open source projects of 10k+ GitHub stars:
https://github.com/protectai/vulnhuntr
/r/MachineLearning
https://redd.it/1ga8wxn
Django admin not displaying registered LogEntry model
Hello, I've been attempting to display the Django built-in model LogEntry in the Django admin page, but it hasn't been successful. I'm using Django version 4.2.9. While my custom models are displaying correctly, the LogEntry model remains absent from the admin panel.
Here's what I've checked so far:
- Confirmed that django.contrib.admin is included in INSTALLEDAPPS
- Ensured the model is registered correctly within the appropriate app
- Even tried registering the model in a completely new (empty) app, which I added to INSTALLEDAPPS, but it still did not appear.
Do you have any suggestions on why this specific model isn't appearing? What else should I consider checking?
/r/django
https://redd.it/1gamxsl
Wednesday Daily Thread: Beginner questions
# Weekly Thread: Beginner Questions 🐍
Welcome to our Beginner Questions thread! Whether you're new to Python or just looking to clarify some basics, this is the thread for you.
## How it Works:
1. Ask Anything: Feel free to ask any Python-related question. There are no bad questions here!
2. Community Support: Get answers and advice from the community.
3. Resource Sharing: Discover tutorials, articles, and beginner-friendly resources.
## Guidelines:
This thread is specifically for beginner questions. For more advanced queries, check out our [Advanced Questions Thread](#advanced-questions-thread-link).
## Recommended Resources:
If you don't receive a response, consider exploring r/LearnPython or join the Python Discord Server for quicker assistance.
## Example Questions:
1. What is the difference between a list and a tuple?
2. How do I read a CSV file in Python?
3. What are Python decorators and how do I use them?
4. How do I install a Python package using pip?
5. What is a virtual environment and why should I use one?
Let's help each other learn Python! 🌟
/r/Python
https://redd.it/1g9wxn3
Anyone working on or with a great but little-known test framework?
If you're developing or enjoying a less popular testing framework with Python, I'd love to hear about it!
I don't love pytest, some of its complexities, tall decorator stacks, and function naming conventions.
I do love ward, with its unusual non-function-naming test names, and unusual defining-functions-in-loops for parameterization. Unfortunately it's now archived, as the developer is busy at Textualize.
Maintaining it myself is probably beyond my abilities and bandwidth, so I plan to migrate some projects to pytest soon, but wanted to check if anyone can show off some fun alternative with something special to offer.
Thanks for any contribution!
/r/Python
https://redd.it/1gbxrho
Webapp hosting resources
I going develop a webapp in django that can to post image and text. Get registion form data from user. Now don't know how much Hosting resource like cpu, ram, bandwidth for 100 to 500 user . Also tell some free and paid webapp Hosting service in low cost for startup
/r/djangolearning
https://redd.it/1gc1xh0
Single line turns the dataclass into a GUI/TUI & CLI application
I've been annoyed for years of the overhead you get when building a user interface. It's easy to write a useful script but to put there CLI flags or a GUI window adds too much code. I've been crawling many times to find a library that handles this without burying me under tons of tutorials.
Last six months I spent doing research and developing a project that requires low to none skills to produce a full app out of nowhere. Unlike alternatives, mininterface requires almost nothing, no code modification at all, no learning. Just use a standard dataclass (or a pydantic model, attrs) to store the configuration and you get (1) CLI / config file parsing and (2) useful dialogs to be used in your app.
I've used this already for several projects in my company and I promise I won't release a new Python project without this ever again. I published it only last month and have presented it on two conferences so far – it's still new. If you are a developer, you are the target audience. What do you think, is the interface intuitive enough? Should I rename a method or something now while the project is still a
/r/Python
https://redd.it/1gbprvv
This is now valid syntax in Python 3.13!
There are a [few changes that didn't get much attention](https://www.bitecode.dev/p/python-313-what-didnt-make-the-headlines) in the last releases, and one of them is that comprehensions and lambdas can now be used in annotations (the place where you put type hints).
As the article mentions, this came from a bug tickets that requested this to work:
class name_2[*name_5, name_3: int]:
(name_3 := name_4)
class name_4[name_5: name_5]((name_4 for name_5 in name_0 if name_3), name_2 if name_3 else name_0):
pass
Here we have a walrus, unpacking, type vars and a comprehension all in one. I tried it in 3.13 (you gotta create a few variables), and yes, it is now valid syntax.
I don't think I have any use for it (except the typevar, it's pretty sweet), but I pity the person that will have to read that one day in a real code base :)
/r/Python
https://redd.it/1gbu1g0
PyGenTree: A Simple Yet Powerful Python Package for Generating ASCII Directory Trees
# What My Project Does
PyGenTree is a Python package that generates ASCII tree representations of directory structures. It's a simple command-line tool that allows you to visualize the structure of your project or any directory on your system. With PyGenTree, you can easily document your project's structure, quickly understand unfamiliar codebases, or generate directory trees for README files.
# Target Audience
PyGenTree is designed for developers, programmers, and anyone who works with directory structures on a regular basis. It's a useful tool for:
* Developers who want to document their project's structure
* Programmers who need to quickly understand unfamiliar codebases
* DevOps teams who want to visualize directory structures for deployment or debugging purposes
* Anyone who wants to generate directory trees for README files or documentation purposes
# Comparison
There are existing tools that generate directory trees, such as `tree` on Linux and `dir` on Windows. There are online ASCII Tree Generators where you have to manually add files and directories. There are some python packages similar to this, but I tried to combine all the useful features from these alternatives and create this one. PyGenTree differs from these alternatives in several ways:
* **Cross-platform compatibility**: PyGenTree works on Windows, macOS, and Linux, making it a great
/r/Python
https://redd.it/1gbnnbu
need help for django with aws s3 bucket
i have a website with backend django (digital ocean ) (dockerize the app )hosted in the backend and vite react project in s3 bucket i keep getting this error , I'm sure settings,py file is correct, i tried all of
CORSALLOWEDORIGINS =
'http://myappsfrontends.s3-website-us-east-1.amazonaws.com',
ALLOWEDHOSTS = ['*']
CORSORIGINALLOWALL = True
and setup the cors middleware in the right order
i spent week searching all of stackoverflow and reddit for solutions and nothing works, so this is the last solution
(i'm using aws just to learn some cloud to increase my skills )
cors policy in aws
[
{
"AllowedHeaders": [
"*"
\],
"AllowedMethods": [
"GET",
"PUT",
"POST",
"DELETE"
\],
"AllowedOrigins": [
"http://myappsfrontends.s3-website-us-east-1.amazonaws.com"
\],
"ExposeHeaders": [
"Content-Range",
"Content-Length",
"ETag"
\],
"MaxAgeSeconds": 3000
}
\]
https://preview.redd.it/hfa5s7c3mrwd1.png?width=1887&format=png&auto=webp&s=739741d0e97e6c6ed2123e09e04616f5d5c1d517
/r/djangolearning
https://redd.it/1gbcw7e
How do Session IDs work?
New to Flask. What I know is there are 2 ways to implement sessions: client-side and server-side. The former uses the default flask session (from flask import session) while the later uses a library called Flask-Session (need to add from flask_session import Session) .
I read both flask and Flask-Session docs, I still can't wrap my head around how sessions really work. The default session will turn your session data dict into cookie, then salt it, add signature, encode in base64. The Flask-Session's session still uses cookie, but it only contains the session identifier.
Session identifier is for identifying users, duh. But I have some questions:
1. Since Flask-Session is just extension of the deault session, do both of them implement the same approach to assigning session ID?
2. Where can I find the session IDs of the users?
3. Is it going to reset after closing the tab? browser?
4. When I do session.clear(), is everything cleared, including the session ID?
Again, sorry for asking these dumb questions. Any help would be appreciated. Thanks!
/r/flask
https://redd.it/1gb6kzq
Personal portfolio
Finally fixed my mobile menu! Really excited about how this is coming along... In the resources section I have a ecomm template but let me know if anyone want this portfolio template in that section so I can add it. More feedback welcome!
thanks in advanced Reddit people!
https://silverboi.me
/r/flask
https://redd.it/1gb664l
REST API Testing - Where to run functional tests?
Hello,
At work, I'm developing a REST API with flask, and I'm wondering where I should run my functional tests.
My current CI/CD pipeline on github actions runs the unit tests (mocking / patching ) for small blocks of code, and also runs the integration tests using a docker compose (spins up database instance, and some other services on the same machine, then runs tests)
Both those tests above run locally, and run during push and merges to github.
I also have functional testing for the REST API, using pytest with request library. Once the docker image is running in a test environment on AWS (EC2), I want to be able to make calls and check if the API is working properly
My question is where should these be run from and what do most professional organizations do? Should they run:
\- Locally? (i.e. my local computer send the request to the live test server on AWS)
\- On the Github action CI/CD pipeline? if so can i configure these to run after the docker image is running?
\- On the EC2 instance itself (maybe in another container)
\- Somewhere else?
Thanks for any advice!
/r/flask
https://redd.it/1gbeeig
cstructpy- Python package designed for binary serialization and deserialization of structured data
This app is open source and is made using Python: https://github.com/Maxim-Mushizky/cstructpy
Also can pip install it via pypi https://pypi.org/project/cstructpy/
# What My Project Does
Provides a simple interface for packing and unpacking binary data based on field definitions using Python's struct module. The motivation for this package is to have a data validation using type annotations, similar to pydantic but for binary data. Therefore this package is best when used alongside pydantic.BaseModel or dataclasses.dataclass since it allows a similar class structure and object creation
# Target Audience
Mostly effective for distributed systems, where there are c like structs passed as binary and need to be verified in different parts of the code.
# Comparison
There are no current comparisons, since this project attempt to mimic the object creation and validation as present in Pydantic
# Contribution
If you require any new features or have a use for this package you are more than welcome to join as a celebrator
Enjoy!
/r/Python
https://redd.it/1gb0o3f
Anyone here going to PyCon Australia next month?
I'll be going for the first time and I'm keen to meet up with fellow Aussie Pythonistas! Anyone interested?
There's a lot of interesting talks planned - are there any in particular you're keen for?
/r/Python
https://redd.it/1gav220
Monoranger: A poetry plugin for managing monorepos
🔗 Link - [https://github.com/ag14774/poetry-monoranger-plugin](https://github.com/ag14774/poetry-monoranger-plugin)
# What my project does
I recently needed to set up a monorepo and I wanted to have similar structure as in Cargo workspaces from Rust.
Essentially I wanted to have a single lockfile shared between all components/projects in the library and have a single venv with all dependencies installed as this makes development so much easier. I use Poetry so I decided to create a plugin for this usecase.
This plugin:
* Enables multiple projects in a monorepo using Poetry to use a shared poetry lockfile
* Enables multiple projects in a monorepo using Poetry to use a shared virtual environment
* Allows projects to use path dependencies and pin their versions during 'poetry build'
# Target Audience
Any Python developer that wants to create a simple monorepo using Poetry and does not want to resort to complex build tools such as Nx. I will be keeping this plugin up to date and make sure that updates and fixes are pushed in a timely manner
# Comparison
The existing tools fall in two categories:
a) Compicated build tools that have their focus on other programming languages but also support Python. An example of this is Nx. It's a nice tool but it has too many features
/r/Python
https://redd.it/1gak200
Thursday Daily Thread: Python Careers, Courses, and Furthering Education!
# Weekly Thread: Professional Use, Jobs, and Education 🏢
Welcome to this week's discussion on Python in the professional world! This is your spot to talk about job hunting, career growth, and educational resources in Python. Please note, this thread is not for recruitment.
---
## How it Works:
1. Career Talk: Discuss using Python in your job, or the job market for Python roles.
2. Education Q&A: Ask or answer questions about Python courses, certifications, and educational resources.
3. Workplace Chat: Share your experiences, challenges, or success stories about using Python professionally.
---
## Guidelines:
- This thread is not for recruitment. For job postings, please see r/PythonJobs or the recruitment thread in the sidebar.
- Keep discussions relevant to Python in the professional and educational context.
---
## Example Topics:
1. Career Paths: What kinds of roles are out there for Python developers?
2. Certifications: Are Python certifications worth it?
3. Course Recommendations: Any good advanced Python courses to recommend?
4. Workplace Tools: What Python libraries are indispensable in your professional work?
5. Interview Tips: What types of Python questions are commonly asked in interviews?
---
Let's help each other grow in our careers and education. Happy discussing! 🌟
/r/Python
https://redd.it/1gap9r6
Talks from PyData Amsterdam 2024 now on YouTube
PyData has uploaded the talks from PyData Amsterdam 2024 (18-20 Sept) to YouTube.
- https://www.youtube.com/playlist?list=PLGVZCDnMOq0reU2lzNZCn9obkyRVaSnpF
- PyDataTV/playlists" rel="nofollow">https://www.youtube.com/@PyDataTV/playlists
- PyDataTV/videos" rel="nofollow">https://www.youtube.com/@PyDataTV/videos
/r/Python
https://redd.it/1ga9frr
I want to hide the DRF API views in my production code.
I have built a full stack mobile-web application using Flutter and Svelte with Django as the backend. All of the mentioned codes have been pushed to production. All of them function on the Django rest framework APIs(GET,POST and DELETE methods).
I have deployed the Django code using Heroku, on entering the production URL API endpoints, you can see that the API views can be accessed to anyone (refer below)
https://preview.redd.it/tpjia8dmwgwd1.png?width=1233&format=png&auto=webp&s=7866a8e5957e3704b606a7fab4df01ca19c29064
I want to know how can I hide this page from others accessing it? Or how can I prevent this data being available online? Please help with this.
/r/django
https://redd.it/1ga5ool
