Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Microsoft is giving away 50,000 FREE Microsoft Certification exam vouchers. Get Fabric certified for FREE! Learn more

Reply
gmd_23
Frequent Visitor

Dataset refresh failures - recent issue

Hi,

 

Is anyonwe else facing multiple dataset filaures on previously working datasets. Problem occurs regardless of datasource, size, complexity of query etc. This occuring since late 3rd Feb. Same error across the board - 

 

{"error":{"code":"ModelRefresh_ShortMessage_ProcessingError","pbi.error":{"code":"ModelRefresh_ShortMessage_ProcessingError","details":[{"code":"ModelRefresh_DataSourceErrorLabel","detail":{"type":1,"value":"The M evaluation exceeded the memory limit. To address the issue consider optimizing the M expressions, reducing the concurrency of operations that are memory intensive or upgrading to increase the available memory. Container exited unexpectedly with code 0x0000DEAD. PID: 5888.\r\nUsed features: (none).;Container exited unexpectedly with code 0x0000DEAD.

 

Regards

 

1 ACCEPTED SOLUTION
nickyvv
Most Valuable Professional
Most Valuable Professional

Hi @gmd_23,

You could try enabling Premium Gen 2 on your capacity, that will for sure get rid of any concurrency or memory refresh problem. Do remember that it is in preview, and that you will not have refresh metrics in the Premium Capacity App anymore. Have a look at all the current limitations.

But you can always switch back if it doesn't solve your problems.

 

If that doesn't help, I suggest you create a support ticket (which is free with a Pro license). Go to the support page to file a support ticket.



Did I answer your question? Mark my post as a solution!

Blog: nickyvv.com | @NickyvV


View solution in original post

10 REPLIES 10
lbendlin
Super User
Super User

If it's any consolation, unnecessary refreshes are something we also see all the time. It's a tricky thing though - how should the service know that the developer did due diligence and updated the data too when they mucked with the report and re-uploaded to the workspace.  Worst case the service does an unneeded refresh, best case it catches the developer napping and inadvertently uploading a really old data snapshot.

lbendlin
Super User
Super User

We have switched to Gen2, and did not regret it yet.  Getting rid of the rendering shackles was totally worth losing a few metrics temporarily. IMHO the only metric that really counts is cumulative query duration, and we still get that from the audit logs.

Not going to discount it as an option, not yet.

 

Seeing other odd behaviour - refreshes that are reported as finished before they've even started. Dataset refreshes after a publish. Refreshes happening even when scheduled refresh is switched off.

 

Our region is North Europe.

gmd_23
Frequent Visitor

Its a P1 capacity, which has been running fine with the same workload for quite some time. Now, all of a sudden its failing spectacularly. The metrics from the capacity app indicate that all is well - nothing hitting memory limits etc.

 

Also reports of odd behaviour where once a dataset is publiched, the system tries to immediately refresh it. Nothing set on schedule, no refresh on demand requested, still it tries to refresh (which typically fails).

 

Problem occurs even with very low level of refresh -  again the metrics indicate low levels of refresh concurrency and 150+ minuites of capacity refresh capacity available, and at a time when there would be little to no user activity.

 

 

nickyvv
Most Valuable Professional
Most Valuable Professional

Hi @gmd_23,

You could try enabling Premium Gen 2 on your capacity, that will for sure get rid of any concurrency or memory refresh problem. Do remember that it is in preview, and that you will not have refresh metrics in the Premium Capacity App anymore. Have a look at all the current limitations.

But you can always switch back if it doesn't solve your problems.

 

If that doesn't help, I suggest you create a support ticket (which is free with a Pro license). Go to the support page to file a support ticket.



Did I answer your question? Mark my post as a solution!

Blog: nickyvv.com | @NickyvV


How can we try enabling it premium gen2 ? could you please list the steps for it ? 

nickyvv
Most Valuable Professional
Most Valuable Professional

Can you explain what your current issue is? Because right now Premium Gen2 is the default for Premium capacity.

In case you mean Dataflow Gen2, that's a Fabric item and you can create that with any Fabric capacity, F2-Fxx and also a trial.



Did I answer your question? Mark my post as a solution!

Blog: nickyvv.com | @NickyvV


Hi Nicky,

 

Thought of that, not having the capacity metrics a huge drawback.

 

What is alarming is that refreshes are failing even at times of low user and refresh activity.

 

This does not feel like "our" problem, but a problem in the data centre, like the recent advisory about log files searching for a "D" drive.

 

v-cazheng-msft
Community Support
Community Support

Hi, @gmd_23 

According to the error message you provided, this issue is caused by exceeding the memory limit. The size of the datasets will grow multiply when refreshing. And If multiple datasets need refresh at the same time, they will competing for memory resources. If the memory is insufficient, even if there is only one model in the capacity, data refresh will not complete.

 

You can try these steps to solve this problem

1 Reduce the number of datasets refreshed concurrently

2 If the capacity is Premium capacity, analyze the refresh history and metrics related with refresh to find the datasets needing optimizing, including removing data unused and reducing queries

3 Scale up the capacity if necessary

 

You can also refer Why are data refreshes not completing.

 

Best Regards,

Caiyun Zheng

 

Is that the answer you're looking for? If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

lbendlin
Super User
Super User

Needs more details. Which SKU are you on? What's the utilization on the capacity?

Helpful resources

Announcements
Notebook Gallery Carousel1

NEW! Community Notebooks Gallery

Explore and share Fabric Notebooks to boost Power BI insights in the new community notebooks gallery.

April2025 Carousel

Fabric Community Update - April 2025

Find out what's new and trending in the Fabric community.

"); $(".slidesjs-pagination" ).prependTo(".pagination_sec"); $(".slidesjs-pagination" ).append("
"); $(".slidesjs-play.slidesjs-navigation").appendTo(".playpause_sec"); $(".slidesjs-stop.slidesjs-navigation").appendTo(".playpause_sec"); $(".slidesjs-pagination" ).append(""); $(".slidesjs-pagination" ).append(""); } catch(e){ } /* End: This code is added by iTalent as part of iTrack COMPL-455 */ $(".slidesjs-previous.slidesjs-navigation").attr('tabindex', '0'); $(".slidesjs-next.slidesjs-navigation").attr('tabindex', '0'); /* start: This code is added by iTalent as part of iTrack 1859082 */ $('.slidesjs-play.slidesjs-navigation').attr('id','playtitle'); $('.slidesjs-stop.slidesjs-navigation').attr('id','stoptitle'); $('.slidesjs-play.slidesjs-navigation').attr('role','tab'); $('.slidesjs-stop.slidesjs-navigation').attr('role','tab'); $('.slidesjs-play.slidesjs-navigation').attr('aria-describedby','tip1'); $('.slidesjs-stop.slidesjs-navigation').attr('aria-describedby','tip2'); /* End: This code is added by iTalent as part of iTrack 1859082 */ }); $(document).ready(function() { if($("#slides .item").length < 2 ) { /* Fixing Single Slide click issue (commented following code)*/ // $(".item").css("left","0px"); $(".item.slidesjs-slide").attr('style', 'left:0px !important'); $(".slidesjs-stop.slidesjs-navigation").trigger('click'); $(".slidesjs-previous").css("display", "none"); $(".slidesjs-next").css("display", "none"); } var items_length = $(".item.slidesjs-slide").length; $(".slidesjs-pagination-item > button").attr("aria-setsize",items_length); $(".slidesjs-next, .slidesjs-pagination-item button").attr("tabindex","-1"); $(".slidesjs-pagination-item button").attr("role", "tab"); $(".slidesjs-previous").attr("tabindex","-1"); $(".slidesjs-next").attr("aria-hidden","true"); $(".slidesjs-previous").attr("aria-hidden","true"); $(".slidesjs-next").attr("aria-label","Next"); $(".slidesjs-previous").attr("aria-label","Previous"); //$(".slidesjs-stop.slidesjs-navigation").attr("role","button"); //$(".slidesjs-play.slidesjs-navigation").attr("role","button"); $(".slidesjs-pagination").attr("role","tablist").attr("aria-busy","true"); $("li.slidesjs-pagination-item").attr("role","list"); $(".item.slidesjs-slide").attr("tabindex","-1"); $(".item.slidesjs-slide").attr("aria-label","item"); /*$(".slidesjs-stop.slidesjs-navigation").on('click', function() { var itemNumber = parseInt($('.slidesjs-pagination-item > a.active').attr('data-slidesjs-item')); $($('.item.slidesjs-slide')[itemNumber]).find('.c-call-to-action').attr('tabindex', '0'); });*/ $(".slidesjs-stop.slidesjs-navigation, .slidesjs-pagination-item > button").on('click keydown', function() { $.each($('.item.slidesjs-slide'),function(i,el){ $(el).find('.c-call-to-action').attr('tabindex', '-1'); }); var itemNumber = parseInt($('.slidesjs-pagination-item > button.active').attr('data-slidesjs-item')); $($('.item.slidesjs-slide')[itemNumber]).find('.c-call-to-action').attr('tabindex', '0'); }); $(".slidesjs-play.slidesjs-navigation").on('click', function() { $.each($('.item.slidesjs-slide'),function(i,el){ $(el).find('.c-call-to-action').attr('tabindex', '-1'); }); }); $(".slidesjs-pagination-item button").keyup(function(e){ var keyCode = e.keyCode || e.which; if (keyCode == 9) { e.preventDefault(); $(".slidesjs-stop.slidesjs-navigation").trigger('click').blur(); $("button.active").focus(); } }); $(".slidesjs-play").on("click",function (event) { if (event.handleObj.type === "click") { $(".slidesjs-stop").focus(); } else if(event.handleObj.type === "keydown"){ if (event.which === 13 && $(event.target).hasClass("slidesjs-play")) { $(".slidesjs-stop").focus(); } } }); $(".slidesjs-stop").on("click",function (event) { if (event.handleObj.type === "click") { $(".slidesjs-play").focus(); } else if(event.handleObj.type === "keydown"){ if (event.which === 13 && $(event.target).hasClass("slidesjs-stop")) { $(".slidesjs-play").focus(); } } }); $(".slidesjs-pagination-item").keydown(function(e){ switch (e.which){ case 37: //left arrow key $(".slidesjs-previous.slidesjs-navigation").trigger('click'); e.preventDefault(); break; case 39: //right arrow key $(".slidesjs-next.slidesjs-navigation").trigger('click'); e.preventDefault(); break; default: return; } $(".slidesjs-pagination-item button.active").focus(); }); }); // Start This code is added by iTalent as part of iTrack 1859082 $(document).ready(function(){ $("#tip1").attr("aria-hidden","true").addClass("hidden"); $("#tip2").attr("aria-hidden","true").addClass("hidden"); $(".slidesjs-stop.slidesjs-navigation, .slidesjs-play.slidesjs-navigation").attr('title', ''); $("a#playtitle").focus(function(){ $("#tip1").attr("aria-hidden","false").removeClass("hidden"); }); $("a#playtitle").mouseover(function(){ $("#tip1").attr("aria-hidden","false").removeClass("hidden"); }); $("a#playtitle").blur(function(){ $("#tip1").attr("aria-hidden","true").addClass("hidden"); }); $("a#playtitle").mouseleave(function(){ $("#tip1").attr("aria-hidden","true").addClass("hidden"); }); $("a#play").keydown(function(ev){ if (ev.which ==27) { $("#tip1").attr("aria-hidden","true").addClass("hidden"); ev.preventDefault(); return false; } }); $("a#stoptitle").focus(function(){ $("#tip2").attr("aria-hidden","false").removeClass("hidden"); }); $("a#stoptitle").mouseover(function(){ $("#tip2").attr("aria-hidden","false").removeClass("hidden"); }); $("a#stoptitle").blur(function(){ $("#tip2").attr("aria-hidden","true").addClass("hidden"); }); $("a#stoptitle").mouseleave(function(){ $("#tip2").attr("aria-hidden","true").addClass("hidden"); }); $("a#stoptitle").keydown(function(ev){ if (ev.which ==27) { $("#tip2").attr("aria-hidden","true").addClass("hidden"); ev.preventDefault(); return false; } }); }); // End This code is added by iTalent as part of iTrack 1859082
Top Solution Authors
Top Kudoed Authors