Skip to Content

Changes for page File based connectivity

Last modified by Erik Bakker on 2026/01/02 11:35
From version 79.1
edited by Erik Bakker
on 2026/01/02 11:35
Change comment: There is no comment for this version
To version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -File based connectivity
1 +Data Pipelines
Default language
... ... @@ -1,1 +1,1 @@
1 -sw
1 +en
Content
... ... @@ -1,8 +1,9 @@
1 -{{velocity}}
2 -#set ($discard = $xwiki.ssx.use('Main.Extensions.ContainerSizingCoursePage.WebHome'))
3 -{{/velocity}}
1 +In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 +eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 +Within eMagiz, we support several combinations of those source and sink systems.
4 +For the combinations that are used most, we have made separate microlearnings to explain how they work.
4 4  
5 -{{container}}{{container layoutStyle="columns"}}(((In this course, we will learn how to use file-based components within eMagiz to set up a connection with an FTP and SFTP. We will build on what we have learned previously in the Novice course on this same topic in this course. For this course, the focus will be setting up a secure connection with the FTP and SFTP.)))((({{html}}<div class="strip__attribute" style="text-align:center"><table><tr><td><img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/></td></tr><tr><td><div class="strip__attribute-label">40-50 minutes</div></td></tr></table></div>{{/html}}))){{/container}}{{/container}}
6 +* **Total time:** between 30 and 45 minutes
6 6  
7 7  
8 8  (% style="border-color:#10137e" %)
... ... @@ -13,17 +13,14 @@
13 13   <main class="master">
14 14   <ul class="strip-container">
15 15   <li class="strip">
16 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-ftp-connectivity" target="_blank" class="strip__link">
17 - <div class="strip__attribute__new__stack">
18 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
19 - </div>
17 + <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
20 20   <label for="" class="strip__label">
21 - <span>227</span>
22 - FTP Connectivity
19 + <span>208</span>
20 + Understanding Data Pipelines
23 23   </label>
24 24   <div class="strip__attribute">
25 25   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
26 - <div class="strip__attribute-label">4 minutes</div>
24 + <div class="strip__attribute-label">5 minutes</div>
27 27   </div>
28 28   <div class="strip__attribute">
29 29   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -32,17 +32,14 @@
32 32   </a>
33 33   </li>
34 34   <li class="strip">
35 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-sftp-connectivity" target="_blank" class="strip__link">
36 - <div class="strip__attribute__new__stack">
37 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
38 - </div>
33 + <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
39 39   <label for="" class="strip__label">
40 - <span>227</span>
41 - SFTP Connectivity
35 + <span>208</span>
36 + Data pipeline - Job Dashboard
42 42   </label>
43 43   <div class="strip__attribute">
44 44   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
45 - <div class="strip__attribute-label">4 minutes</div>
40 + <div class="strip__attribute-label">5 minutes</div>
46 46   </div>
47 47   <div class="strip__attribute">
48 48   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -51,17 +51,14 @@
51 51   </a>
52 52   </li>
53 53   <li class="strip">
54 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-emagiz-sftp-connectivity" target="_blank" class="strip__link">
55 - <div class="strip__attribute__new__stack">
56 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
57 - </div>
49 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
58 58   <label for="" class="strip__label">
59 - <span>227</span>
60 - eMagiz SFTP Connectivity
51 + <span>208</span>
52 + Data pipeline - Mendix to AWS Redshift
61 61   </label>
62 62   <div class="strip__attribute">
63 63   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
64 - <div class="strip__attribute-label">6 minutes</div>
56 + <div class="strip__attribute-label">10 minutes</div>
65 65   </div>
66 66   <div class="strip__attribute">
67 67   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -70,81 +70,21 @@
70 70   </a>
71 71   </li>
72 72   <li class="strip">
73 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/eMagiz%20SFTP%20Connection%20guide" target="_blank" class="strip__link">
74 - <div class="strip__attribute__new__stack">
75 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
76 - </div>
65 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
77 77   <label for="" class="strip__label">
78 - <span>227</span>
79 - eMagiz SFTP Connection guide
67 + <span>208</span>
68 + Data pipeline - Mendix to SFTP
80 80   </label>
81 81   <div class="strip__attribute">
82 82   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
83 - <div class="strip__attribute-label">3 minutes</div>
72 + <div class="strip__attribute-label">7 minutes</div>
84 84   </div>
85 85   <div class="strip__attribute">
86 86   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
87 87   <div class="strip__attribute-label">Developer</div>
88 88   </div>
89 - </a>
78 + </a>
90 90   </li>
91 - <li class="strip">
92 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-sftp-security" target="_blank" class="strip__link">
93 - <div class="strip__attribute__new__stack">
94 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
95 - </div>
96 - <label for="" class="strip__label">
97 - <span>227</span>
98 - SFTP Security
99 - </label>
100 - <div class="strip__attribute">
101 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
102 - <div class="strip__attribute-label">5 minutes</div>
103 - </div>
104 - <div class="strip__attribute">
105 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
106 - <div class="strip__attribute-label">Developer</div>
107 - </div>
108 - </a>
109 - </li>
110 - <li class="strip">
111 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-sftp-known-hosts" target="_blank" class="strip__link">
112 - <div class="strip__attribute__new__stack">
113 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
114 - </div>
115 - <label for="" class="strip__label">
116 - <span>227</span>
117 - SFTP Known Hosts
118 - </label>
119 - <div class="strip__attribute">
120 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
121 - <div class="strip__attribute-label">4 minutes</div>
122 - </div>
123 - <div class="strip__attribute">
124 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
125 - <div class="strip__attribute-label">Developer</div>
126 - </div>
127 - </a>
128 - </li>
129 - <li class="strip">
130 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-smb-connectivity" target="_blank" class="strip__link">
131 - <div class="strip__attribute__new__stack">
132 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
133 - </div>
134 - <label for="" class="strip__label">
135 - <span>227</span>
136 - SMB Connectivity
137 - </label>
138 - <div class="strip__attribute">
139 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
140 - <div class="strip__attribute-label">4 minutes</div>
141 - </div>
142 - <div class="strip__attribute">
143 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
144 - <div class="strip__attribute-label">Developer</div>
145 - </div>
146 - </a>
147 - </li>
148 148   </ul>
149 149   </main>
150 150   </div>