Skip to Content

Changes for page File based connectivity

Last modified by Erik Bakker on 2026/01/02 11:35
From version 73.1
edited by BoukeReitsma
on 2024/05/13 13:27
Change comment: There is no comment for this version
To version 36.1
edited by Erik Bakker
on 2022/05/03 13:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Title
... ... @@ -1,1 +1,1 @@
1 -File based connectivity
1 +Data Pipelines
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.BoukeReitsma
1 +XWiki.ebakker
Content
... ... @@ -1,8 +1,9 @@
1 -{{velocity}}
2 -#set ($discard = $xwiki.ssx.use('Main.Extensions.ContainerSizingCoursePage.WebHome'))
3 -{{/velocity}}
1 +In this course we will focus on data pipelines. Data Pipelines are one of the lesser known integration patterns that eMagiz supports.
2 +eMagiz Data Pipelines are good in transporting large quantities of data with no need for transformation between source and sink.
3 +Within eMagiz, we support several combinations of those source and sink systems.
4 +For the combinations that are used most, we have made separate microlearnings to explain how they work.
4 4  
5 -{{container}}{{container layoutStyle="columns"}}(((In this course, we will learn how to use file-based components within eMagiz to set up a connection with an FTP and SFTP. We will build on what we have learned previously in the Novice course on this same topic in this course. For this course, the focus will be setting up a secure connection with the FTP and SFTP.)))((({{html}}<div class="strip__attribute" style="text-align:center"><table><tr><td><img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/></td></tr><tr><td><div class="strip__attribute-label">40-50 minutes</div></td></tr></table></div>{{/html}}))){{/container}}{{/container}}
6 +* **Total time:** between 30 and 45 minutes
6 6  
7 7  
8 8  (% style="border-color:#10137e" %)
... ... @@ -13,17 +13,14 @@
13 13   <main class="master">
14 14   <ul class="strip-container">
15 15   <li class="strip">
16 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-ftp-connectivity" target="_blank" class="strip__link">
17 - <div class="strip__attribute__new__stack">
18 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
19 - </div>
17 + <a href="../../docs/microlearning/intermediate-data-pipelines-understanding-data-pipelines" class="strip__link">
20 20   <label for="" class="strip__label">
21 - <span>227</span>
22 - FTP Connectivity
19 + <span>208</span>
20 + Understanding Data Pipelines
23 23   </label>
24 24   <div class="strip__attribute">
25 25   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
26 - <div class="strip__attribute-label">4 minutes</div>
24 + <div class="strip__attribute-label">5 minutes</div>
27 27   </div>
28 28   <div class="strip__attribute">
29 29   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -32,13 +32,10 @@
32 32   </a>
33 33   </li>
34 34   <li class="strip">
35 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-ftp-connectivity-exercise" target="_blank" class="strip__link">
36 - <div class="strip__attribute__new__stack">
37 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg"/>
38 - </div>
33 + <a href="../../docs/microlearning/intermediate-data-pipelines-job-dashboard-for-data-pipeline" class="strip__link">
39 39   <label for="" class="strip__label">
40 - <span>227</span>
41 - FTP Connectivity
35 + <span>208</span>
36 + Data pipeline - Job Dashboard
42 42   </label>
43 43   <div class="strip__attribute">
44 44   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
... ... @@ -51,17 +51,14 @@
51 51   </a>
52 52   </li>
53 53   <li class="strip">
54 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-sftp-connectivity" target="_blank" class="strip__link">
55 - <div class="strip__attribute__new__stack">
56 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
57 - </div>
49 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-aws-redshift" class="strip__link">
58 58   <label for="" class="strip__label">
59 - <span>227</span>
60 - SFTP Connectivity
51 + <span>208</span>
52 + Data pipeline - Mendix to AWS Redshift
61 61   </label>
62 62   <div class="strip__attribute">
63 63   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
64 - <div class="strip__attribute-label">4 minutes</div>
56 + <div class="strip__attribute-label">10 minutes</div>
65 65   </div>
66 66   <div class="strip__attribute">
67 67   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -70,17 +70,14 @@
70 70   </a>
71 71   </li>
72 72   <li class="strip">
73 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-sftp-connectivity-exercise" target="_blank" class="strip__link">
74 - <div class="strip__attribute__new__stack">
75 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg"/>
76 - </div>
65 + <a href="../../docs/microlearning/intermediate-data-pipelines-datapipeline-mendix-to-sftp" class="strip__link">
77 77   <label for="" class="strip__label">
78 - <span>227</span>
79 - SFTP Connectivity
67 + <span>208</span>
68 + Data pipeline - Mendix to SFTP
80 80   </label>
81 81   <div class="strip__attribute">
82 82   <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
83 - <div class="strip__attribute-label">5 minutes</div>
72 + <div class="strip__attribute-label">7 minutes</div>
84 84   </div>
85 85   <div class="strip__attribute">
86 86   <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
... ... @@ -88,101 +88,6 @@
88 88   </div>
89 89   </a>
90 90   </li>
91 - <li class="strip">
92 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-emagiz-sftp-connectivity" target="_blank" class="strip__link">
93 - <div class="strip__attribute__new__stack">
94 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
95 - </div>
96 - <label for="" class="strip__label">
97 - <span>227</span>
98 - eMagiz SFTP Connectivity
99 - </label>
100 - <div class="strip__attribute">
101 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
102 - <div class="strip__attribute-label">6 minutes</div>
103 - </div>
104 - <div class="strip__attribute">
105 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
106 - <div class="strip__attribute-label">Developer</div>
107 - </div>
108 - </a>
109 - </li>
110 - <li class="strip">
111 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/eMagiz%20SFTP%20Connection%20guide" target="_blank" class="strip__link">
112 - <div class="strip__attribute__new__stack">
113 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
114 - </div>
115 - <label for="" class="strip__label">
116 - <span>227</span>
117 - eMagiz SFTP Connection guide
118 - </label>
119 - <div class="strip__attribute">
120 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
121 - <div class="strip__attribute-label">3 minutes</div>
122 - </div>
123 - <div class="strip__attribute">
124 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
125 - <div class="strip__attribute-label">Developer</div>
126 - </div>
127 - </a>
128 - </li>
129 - <li class="strip">
130 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-emagiz-sftp-connectivity-exercise" target="_blank" class="strip__link">
131 - <div class="strip__attribute__new__stack">
132 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-exercises32.svg"/>
133 - </div>
134 - <label for="" class="strip__label">
135 - <span>227</span>
136 - eMagiz SFTP
137 - </label>
138 - <div class="strip__attribute">
139 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
140 - <div class="strip__attribute-label">5 minutes</div>
141 - </div>
142 - <div class="strip__attribute">
143 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
144 - <div class="strip__attribute-label">Developer</div>
145 - </div>
146 - </a>
147 - </li>
148 - <li class="strip">
149 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/intermediate-file-based-connectivity-sftp-security" target="_blank" class="strip__link">
150 - <div class="strip__attribute__new__stack">
151 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
152 - </div>
153 - <label for="" class="strip__label">
154 - <span>227</span>
155 - SFTP Security
156 - </label>
157 - <div class="strip__attribute">
158 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
159 - <div class="strip__attribute-label">5 minutes</div>
160 - </div>
161 - <div class="strip__attribute">
162 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
163 - <div class="strip__attribute-label">Developer</div>
164 - </div>
165 - </a>
166 - </li>
167 - <li class="strip">
168 - <a href="/bin/view/Main/eMagiz%20Academy/Microlearnings/Intermediate%20Level/File%20based%20connectivity/SMB%20Connectivity" target="_blank" class="strip__link">
169 - <div class="strip__attribute__new__stack">
170 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-reading32.svg"/>
171 - </div>
172 - <label for="" class="strip__label">
173 - <span>227</span>
174 - SMB Connectivity
175 - </label>
176 - <div class="strip__attribute">
177 - <img class="strip__attribute-icon strip__attribute-icon--duration" src="/bin/download/Main/Images/General/WebHome/icon-duration32.svg"/>
178 - <div class="strip__attribute-label">4 minutes</div>
179 - </div>
180 - <div class="strip__attribute">
181 - <img class="strip__attribute-icon strip__attribute-icon--roles" src="/bin/download/Main/Images/General/WebHome/icon-roles32.svg"/>
182 - <div class="strip__attribute-label">Developer</div>
183 - </div>
184 - </a>
185 - </li>
186 186   </ul>
187 187   </main>
188 188   </div>