6164
We are building world's most useful & helpful IM-based Azure community!
they way i understand this and my analysis is as follows..
if the source and transformations are fast, bt the overall duration is high the bottleneck is almost certainly the sink's ingestion rate or request overhead—especially since you're dealing with a CRM. As you know it has a typically strict api throttling and high per request latency »
you can speed it up» for instance small batch prevent timeouts, they can actually slowdown execution if not handled properly. every timeadf sends it incurs network overheard and API authentication handshake time. the fix would be is it increase write batch size usually 500 and 5000 records depending on the crm.
Check row by row processing » For Each activity with a Web Activity or a Stored Procedure inside it to load the CRM, ADF executes these sequentially by default. so what i think could fix is ..ensure sequential is unchecked if no checked then set a batch count upto 50 to process multiple chunks of data at once>
Earlier you had mentioned the sources isn;t the issue check these areas
Integration Runtime (IR) > Are you using a Self-Hosted IR? If so, check the CPU/Memory on that VM. If it's hitting 100%, the pipeline will crawl regardless of data size.
CRM Throttling > Most CRMs return a 429 Too Many Requests or simply slow down (tarpitting) when hit too hard. Check if your CRM logs show "Service Unavailable" or " "Rate Limit Exceeded."
DIU Settings,"In your Copy Activity, check the Data Integration Units (DIU). If it's set to ""Auto,"" ADF might be under-allocating resources for a ""small"" volume of records. Try manually setting it to 4 or 8."
I would recommend stating method
1. stage to blob - dump you data into csv or parquet file in azure blob storage
2. bulk api - use crm specific blulk api (e.g., Salesforce Bulk API 2.0 or Dynamics 365 Data Export Service/Dataverse 4-way parallel load).
3.
Hi everyone,
This is Manikanta. I’m currently exploring new job opportunities.
Skill set: Azure IaaS & PaaS, Azure DevOps, Windows Administration.
If you’re aware of any suitable openings or referrals, please let me know.
Thank you in advance
@Th33qualiz3r r u there
Читать полностью…
Pls ask and also tell us what have you tried so far
Читать полностью…
📢 AzureTalk is Back!
Hi everyone, I’m excited to share that we are officially resuming our AzureTalk sessions. Get ready to dive back into the latest in Azure cloud architecture and innovation.
I’ll be posting the formal announcement and session links here in the chat shortly—stay tuned!
Best,
Niraj Kumar Founder, AzureTalk
https://youtube.com/c/azuretalk
Any iot expert in group?
Читать полностью…
Hi everyone,
I am looking for a job change. I have 5 years of experience in Azure Cloud, please let me know any openings
My skill set :
Azure IaaS & PaaS
Azure DevOps
What's your question finish it
Читать полностью…
An [437671070] used a banned word.
Action: Kicked ❗️
Hi Rocky , Welcome to AzureTalk technical community.
Please join our Job Group for any job postings /channel/AzureTalkJobs. Repeated job posts may considered spam here and may lead to ban.
You can watch all our previous sessions at https://www.youtube.com/c/azuretalk
Hi Kavya , Welcome to AzureTalk technical community.
Please join our Job Group for any job postings /channel/AzureTalkJobs. Repeated job posts may considered spam here and may lead to ban.
You can watch all our previous sessions at https://www.youtube.com/c/azuretalk
Hi, everyone, I am looking for amy document, article, video for understanding Microsoft service fabric cluster on an on-premise setup. Please share any knowledge base articles, videos for configuration, troubleshooting issues...
Читать полностью…
Has anyone completed az 204 renew certification??
Читать полностью…
Why would u do it in the first pla
Читать полностью…
Can you share that bro ..meanwhile what I think is supposed to be fixed that error is :
To reduce lookup overhead during upserts, we can create and activate an alternate key on a unique Account field and sharing the logical name. Additionally, plugins or Power Automate flows triggered also impact on slowness .
I think I found out sorry it took me a whole will share it
Читать полностью…
I'm trying to make an ADF pipeline stable and faster by loading data into CRM in small batches instead of a single bulk load. I've already tried ADF tuning .We’re facing a performance issue in an ADF pipeline where processing a relatively small volume of records is taking an unusually long time. We’ve validated that the source read and transformation steps are not the bottleneck, but the overall pipeline execution still remains slow. We’d like your help to analyze where the delay is occurring and identify the correct way to handle this scenario efficiently.
Читать полностью…
Hi everyone,
I have query related to adf pipeline execution,can anyone help me out
For anyone exploring SAP + AI: this episode breaks down why tables need a different model approach and shows demos/patterns.
https://youtu.be/CbUDRgEO0yI?si=HDKDd6zKw-G5ngAy
Hi Mackenzie Graham , Welcome to AzureTalk technical community.
Please join our Job Group for any job postings /channel/AzureTalkJobs. Repeated job posts may considered spam here and may lead to ban.
You can watch all our previous sessions at https://www.youtube.com/c/azuretalk
📣 You’re invited to 𝐃𝐚𝐭𝐚𝐛𝐫𝐢𝐜𝐤𝐬 𝐀𝐜𝐜𝐞𝐥𝐞𝐫𝐚𝐭𝐞: 𝐈𝐧𝐝𝐢𝐚 𝐃𝐚𝐭𝐚 + 𝐀𝐈 𝐓𝐫𝐚𝐢𝐧𝐢𝐧𝐠 𝐃𝐚𝐲 - an immersive, virtual hands-on training with Databricks experts on 22–23 Jan 2026.
Register now: https://shorturl.at/r9p6B
Highlights
• GenAI & RAG: Build contextual AI solutions with Vector Search & Mosaic AI
• SQL & ML: Create analytics workflows + production-ready ML models
• Lakeflow Pipelines: Ingest, process & orchestrate data with declarative pipelines
🎁 Bonus: Refer colleagues who’d benefit and earn rewards.
Is anyone in this group working in the UK with an IT company?
Читать полностью…
Hi Noob , Welcome to AzureTalk technical community.
Please join our Job Group for any job postings /channel/AzureTalkJobs. Repeated job posts may considered spam here and may lead to ban.
You can watch all our previous sessions at https://www.youtube.com/c/azuretalk
Hi Jqqqj , Welcome to AzureTalk technical community.
Please join our Job Group for any job postings /channel/AzureTalkJobs. Repeated job posts may considered spam here and may lead to ban.
You can watch all our previous sessions at https://www.youtube.com/c/azuretalk
Hi Kapil , Welcome to AzureTalk technical community.
Please join our Job Group for any job postings /channel/AzureTalkJobs. Repeated job posts may considered spam here and may lead to ban.
You can watch all our previous sessions at https://www.youtube.com/c/azuretalk
I have all this courses at cheap rates dm to get more information
Читать полностью…
Yes what do you want to know ask complete question here
Читать полностью…
I'm an independent azure expert, helping interviews to secure offers and providing ongoing monthly work support.
Читать полностью…
Dear all . Pls beware of it he is a scammer he asked me for transfer money for giving exam pools but till today I am trying on his telegram he is not responding. Pls beware
Читать полностью…