Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Microsoft is giving away 50,000 FREE Microsoft Certification exam vouchers. Get Fabric certified for FREE! Learn more

Reply
coverturfLSH
Resolver I
Resolver I

Pipeline - Copy Data - Amazon Redshift - No gateway option

Hi,

 

Wondering if this is intentional or not. But I'm trying to set up a "Copy Data" activity in a Pipeline from AWS Redshift. In all of the other data sources I checked there is an option to select a Gateway (exhibit 1). However, when I choose AWS Redshift as a source. There is no option for a gateway (exhibit 2).

 

Exhibit 1 - Azure SQL Server

coverturfLSH_1-1729030547286.png

 

Exhibit 2 - Amazon Redshift

coverturfLSH_0-1729030525393.png

 

Thanks,

 

1 ACCEPTED SOLUTION

Hi Nono,

Thank you for your response. I guess my question is why not offer/use a gateway for the connection. I know it's not required per your earlier reponse. However, it DOES work with a gateway with the DFG2s. Perhaps there's some technical reason that it wants to use a direct connection instead of a gateway.

 

However it's unexpected behavior that we would need to utilize a different authentication method than we have been using with PowerBI (semantic model and DFG2 refreshes) this entire time. 

View solution in original post

7 REPLIES 7
FatherLizard
Frequent Visitor

Having the same issue.

v-nuoc-msft
Community Support
Community Support

Hi @coverturfLSH 

 

"However, when I choose AWS Redshift as a source. There is no option for a gateway (exhibit 2)." First of all, in response to your question: The documentation states that it does not require a gateway.

 

vnuocmsft_0-1729126293674.png

 

https://learn.microsoft.com/en-us/fabric/data-factory/connector-amazon-redshift-overview#support-in-...

 

This is the answer to your question.

 

Since your IT team is connected through service account management, you can ask them if they can create a specific role or user for you with the necessary permissions.

 

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Hi Nono,

Thank you for your response. I guess my question is why not offer/use a gateway for the connection. I know it's not required per your earlier reponse. However, it DOES work with a gateway with the DFG2s. Perhaps there's some technical reason that it wants to use a direct connection instead of a gateway.

 

However it's unexpected behavior that we would need to utilize a different authentication method than we have been using with PowerBI (semantic model and DFG2 refreshes) this entire time. 

Hi  @coverturfLSH 

 

Have you solved the problem now?

 

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Technically yes, as there does not seem to be a solution for my problem.  

v-nuoc-msft
Community Support
Community Support

Hi @coverturfLSH 

 

Unlike some other data sources, such as Azure SQL Server, AWS Redshift does not require a gateway for data transfer. This is primarily because Redshift is designed to work directly with AWS services, particularly Amazon S3, which is often used for data loading.


Direct Connection: Redshift can connect directly to data sources like S3, DynamoDB, or EMR without needing a gateway.


Data Loading: The typical method for loading data into Redshift is through the COPY command, which pulls data from S3 or other supported sources directly into your Redshift tables.


Configuration: Ensure that your IAM roles and permissions are correctly set up to allow Redshift to access the data sources.

 

Amazon Redshift connector overview - Microsoft Fabric | Microsoft Learn

 

Configure Amazon Redshift in a copy activity - Microsoft Fabric | Microsoft Learn

 

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Hi Nono,

I may not fully understand the technical side of your response. I'm currently using a gateway that my IT team set up to connect to Redshift. They manage the connection via a service account and granted me access to the gateway. I've been using the gateway to connect to Redshift to refresh my semantic models and dataflows. 

 

When I try to create a copy activity in the pipeline it asks for a username and password which I'm not sure the IT team would be willing to share with me. Any other thoughts on how I could create a connection to Redshift?

Helpful resources

Announcements
MarchFBCvideo - carousel

Fabric Monthly Update - March 2025

Check out the March 2025 Fabric update to learn about new features.

March2025 Carousel

Fabric Community Update - March 2025

Find out what's new and trending in the Fabric community.

"); $(".slidesjs-pagination" ).prependTo(".pagination_sec"); $(".slidesjs-pagination" ).append("
"); $(".slidesjs-play.slidesjs-navigation").appendTo(".playpause_sec"); $(".slidesjs-stop.slidesjs-navigation").appendTo(".playpause_sec"); $(".slidesjs-pagination" ).append(""); $(".slidesjs-pagination" ).append(""); } catch(e){ } /* End: This code is added by iTalent as part of iTrack COMPL-455 */ $(".slidesjs-previous.slidesjs-navigation").attr('tabindex', '0'); $(".slidesjs-next.slidesjs-navigation").attr('tabindex', '0'); /* start: This code is added by iTalent as part of iTrack 1859082 */ $('.slidesjs-play.slidesjs-navigation').attr('id','playtitle'); $('.slidesjs-stop.slidesjs-navigation').attr('id','stoptitle'); $('.slidesjs-play.slidesjs-navigation').attr('role','tab'); $('.slidesjs-stop.slidesjs-navigation').attr('role','tab'); $('.slidesjs-play.slidesjs-navigation').attr('aria-describedby','tip1'); $('.slidesjs-stop.slidesjs-navigation').attr('aria-describedby','tip2'); /* End: This code is added by iTalent as part of iTrack 1859082 */ }); $(document).ready(function() { if($("#slides .item").length < 2 ) { /* Fixing Single Slide click issue (commented following code)*/ // $(".item").css("left","0px"); $(".item.slidesjs-slide").attr('style', 'left:0px !important'); $(".slidesjs-stop.slidesjs-navigation").trigger('click'); $(".slidesjs-previous").css("display", "none"); $(".slidesjs-next").css("display", "none"); } var items_length = $(".item.slidesjs-slide").length; $(".slidesjs-pagination-item > button").attr("aria-setsize",items_length); $(".slidesjs-next, .slidesjs-pagination-item button").attr("tabindex","-1"); $(".slidesjs-pagination-item button").attr("role", "tab"); $(".slidesjs-previous").attr("tabindex","-1"); $(".slidesjs-next").attr("aria-hidden","true"); $(".slidesjs-previous").attr("aria-hidden","true"); $(".slidesjs-next").attr("aria-label","Next"); $(".slidesjs-previous").attr("aria-label","Previous"); //$(".slidesjs-stop.slidesjs-navigation").attr("role","button"); //$(".slidesjs-play.slidesjs-navigation").attr("role","button"); $(".slidesjs-pagination").attr("role","tablist").attr("aria-busy","true"); $("li.slidesjs-pagination-item").attr("role","list"); $(".item.slidesjs-slide").attr("tabindex","-1"); $(".item.slidesjs-slide").attr("aria-label","item"); /*$(".slidesjs-stop.slidesjs-navigation").on('click', function() { var itemNumber = parseInt($('.slidesjs-pagination-item > a.active').attr('data-slidesjs-item')); $($('.item.slidesjs-slide')[itemNumber]).find('.c-call-to-action').attr('tabindex', '0'); });*/ $(".slidesjs-stop.slidesjs-navigation, .slidesjs-pagination-item > button").on('click keydown', function() { $.each($('.item.slidesjs-slide'),function(i,el){ $(el).find('.c-call-to-action').attr('tabindex', '-1'); }); var itemNumber = parseInt($('.slidesjs-pagination-item > button.active').attr('data-slidesjs-item')); $($('.item.slidesjs-slide')[itemNumber]).find('.c-call-to-action').attr('tabindex', '0'); }); $(".slidesjs-play.slidesjs-navigation").on('click', function() { $.each($('.item.slidesjs-slide'),function(i,el){ $(el).find('.c-call-to-action').attr('tabindex', '-1'); }); }); $(".slidesjs-pagination-item button").keyup(function(e){ var keyCode = e.keyCode || e.which; if (keyCode == 9) { e.preventDefault(); $(".slidesjs-stop.slidesjs-navigation").trigger('click').blur(); $("button.active").focus(); } }); $(".slidesjs-play").on("click",function (event) { if (event.handleObj.type === "click") { $(".slidesjs-stop").focus(); } else if(event.handleObj.type === "keydown"){ if (event.which === 13 && $(event.target).hasClass("slidesjs-play")) { $(".slidesjs-stop").focus(); } } }); $(".slidesjs-stop").on("click",function (event) { if (event.handleObj.type === "click") { $(".slidesjs-play").focus(); } else if(event.handleObj.type === "keydown"){ if (event.which === 13 && $(event.target).hasClass("slidesjs-stop")) { $(".slidesjs-play").focus(); } } }); $(".slidesjs-pagination-item").keydown(function(e){ switch (e.which){ case 37: //left arrow key $(".slidesjs-previous.slidesjs-navigation").trigger('click'); e.preventDefault(); break; case 39: //right arrow key $(".slidesjs-next.slidesjs-navigation").trigger('click'); e.preventDefault(); break; default: return; } $(".slidesjs-pagination-item button.active").focus(); }); }); // Start This code is added by iTalent as part of iTrack 1859082 $(document).ready(function(){ $("#tip1").attr("aria-hidden","true").addClass("hidden"); $("#tip2").attr("aria-hidden","true").addClass("hidden"); $(".slidesjs-stop.slidesjs-navigation, .slidesjs-play.slidesjs-navigation").attr('title', ''); $("a#playtitle").focus(function(){ $("#tip1").attr("aria-hidden","false").removeClass("hidden"); }); $("a#playtitle").mouseover(function(){ $("#tip1").attr("aria-hidden","false").removeClass("hidden"); }); $("a#playtitle").blur(function(){ $("#tip1").attr("aria-hidden","true").addClass("hidden"); }); $("a#playtitle").mouseleave(function(){ $("#tip1").attr("aria-hidden","true").addClass("hidden"); }); $("a#play").keydown(function(ev){ if (ev.which ==27) { $("#tip1").attr("aria-hidden","true").addClass("hidden"); ev.preventDefault(); return false; } }); $("a#stoptitle").focus(function(){ $("#tip2").attr("aria-hidden","false").removeClass("hidden"); }); $("a#stoptitle").mouseover(function(){ $("#tip2").attr("aria-hidden","false").removeClass("hidden"); }); $("a#stoptitle").blur(function(){ $("#tip2").attr("aria-hidden","true").addClass("hidden"); }); $("a#stoptitle").mouseleave(function(){ $("#tip2").attr("aria-hidden","true").addClass("hidden"); }); $("a#stoptitle").keydown(function(ev){ if (ev.which ==27) { $("#tip2").attr("aria-hidden","true").addClass("hidden"); ev.preventDefault(); return false; } }); }); // End This code is added by iTalent as part of iTrack 1859082