PostgreSQL

08 Dec 2024 15:41

Nothing to do from pgbackrest side, you should look at what's writing that much Wal and optimise. Compression type zstd or lz4 works best but not going to help with rate of growth.

PostgreSQL

08 Dec 2024 15:09

Hey guys,

I use pgbackrest as my backup tool. However, I noticed that my repository keep on growing so quickly and largely.

Is there any way to optimise this pls? anything to do other than decide on archive_timeout parameter or compressing?

PostgreSQL

08 Dec 2024 04:59

What is the best way to use a long running query in standby node? It has streaming configured. Looks vacuum issue occur when Hot_standby_feedback=on

PostgreSQL

06 Dec 2024 15:03

Probably aurora is the issue. Does it have access (is anything else connecting using same fdw) or does it kill/block that session? Did you check security groups settings in aurora?

PostgreSQL

06 Dec 2024 14:42

it was in conf but I have to remove hence error

PostgreSQL

06 Dec 2024 14:14

hello, just install pg17 cluster, and try to get cluster info from bgw_replstatus, but pg throws

ERROR: could not find function "bgw_replstatus_main" in file "/usr/pgsql-17/lib/bgw_replstatus.so"

is there bug or something I miss

PostgreSQL

06 Dec 2024 10:46

Wait event message is clear. You need to debug on Aurora. They have performamce insight, explain plan and AWS support.

PostgreSQL

06 Dec 2024 09:16

Well, pg_stat_activity from AWS, wireshark locally.
You may want to log ssl keys if you use ssl (something like https://github.com/wpbrown/openssl-keylog ), however even without that keys wireshark gathers some reasonable info.

Also, it could be connection/mtu issues. Wireshark also could help, but just disabling path mtu discovery and using minimal packets — could solve this problem.

PostgreSQL

06 Dec 2024 05:13

My postgres is in windows

PostgreSQL

05 Dec 2024 18:40

Anyone have idea about data engineers and skills required for same or the tools which are helpful?? Kindly share me the path!! DM me..

PostgreSQL

04 Dec 2024 14:02

Plz let me know about it

PostgreSQL

04 Dec 2024 13:51

Can you tell me to create tsdb infra in HA

PostgreSQL

04 Dec 2024 08:48

Use whatever method you prefer. Postgresql does not do it for you

PostgreSQL

04 Dec 2024 07:25

Hello and welcome to this chat. Here we discuss PostgreSQL and provide best-effort voluntary support on Postgresql issues.
If you have any question, try asking kindly, including log files, error descriptions and perhaps what you're trying to do.

- 🚫 photos and screenshots
- 🚫 spam and offtopic
- ✅ questions with log files and clear explanation of what's gone wrong

⬇️ Press the button down here ⬇️

PostgreSQL

04 Dec 2024 05:37

what we should do it require to monitoring filesystem regularly .

PostgreSQL

08 Dec 2024 15:34

What's your retention policy? Are you concerned with total size or just rate of growth?

PostgreSQL

08 Dec 2024 06:14

There is no perfect solution. You might consider using a logical replica instead of a binary replica for very long-running queries.

PostgreSQL

06 Dec 2024 15:08

Some queries are getting through, some are not

PostgreSQL

06 Dec 2024 14:45

okay. I tried to see the session running on the aurora side and I could not see the session related to my query there.

Is there something that the query has even crossed my Server(FWD extension could be the issue)?

PostgreSQL

06 Dec 2024 14:22

AFAIK the last release broke some ABIs, which is why there was an intermediate release end of November. Are you on 17.2?
Also, did you set

shared_preload_libraries = 'bgw_replstatus'

PostgreSQL

06 Dec 2024 12:11

Can you adjust the chunk size in that FDW?

PostgreSQL

06 Dec 2024 10:32

Any other Suggestion, Please?

PostgreSQL

06 Dec 2024 08:10

Well, apart from hundreds of snake oil products that you can probably buy for the purpose, there's e.g. https://www.gpg4win.org/

PostgreSQL

05 Dec 2024 22:10

Hi

I have PostgreSQL db on prem and I am running a query which includes few foreign tables sit on AWS aurora PostgreSQL read only instance.

This query stuck for ever with wait event "External" anad event type "External"

Other query which is having foreign tables are running and giving output .

Any thoughts? Any suggestions how to debug it?

PostgreSQL

04 Dec 2024 14:56

thank u for your response about
https://gist.github.com/rogergcc/913dee43310d35cda9a3383e094bed1b#file-aqp-geojson

PostgreSQL

04 Dec 2024 14:02

Hi do anyone know about role based access control

PostgreSQL

04 Dec 2024 08:51

Pgbackrest has encryption built in. If you use a repo host on top, you can divide your eggs into different baskets, which is a Good Thing (TM)

PostgreSQL

04 Dec 2024 08:21

Can we encrypt backup file for security purpose

PostgreSQL

04 Dec 2024 05:41

Honestly, this gets complicated... Whatever monitoring tool you use, you should point at these things. And set appropriate alarms. I've written my own, as well as leveraged a few others. A couple free Nagios, etc. As well as paid ones.
The important things are:
1) Monitoring
2) At least DUMPING (pg_dump), and practicing your restores
3) Having Backups, and testing the restores. PgBackrest, etc. etc.

Without that. You are BEGGING for data loss. (My personal NAS just died b/c the power supply).
Stuff Happens. And you are not a professional if you don't know how to recover your DB! LOL

PostgreSQL

04 Dec 2024 05:37

thank for remind brother