Sign In Start Free Trial
Account

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Pentaho Data Integration 4 Cookbook
  • Table Of Contents Toc
  • Feedback & Rating feedback
Pentaho Data Integration 4 Cookbook

Pentaho Data Integration 4 Cookbook

4.8 (8)
close
close
Pentaho Data Integration 4 Cookbook

Pentaho Data Integration 4 Cookbook

4.8 (8)

Overview of this book

Pentaho Data Integration (PDI, also called Kettle), one of the data integration tools leaders, is broadly used for all kind of data manipulation such as migrating data between applications or databases, exporting data from databases to flat files, data cleansing, and much more. Do you need quick solutions to the problems you face while using Kettle? Pentaho Data Integration 4 Cookbook explains Kettle features in detail through clear and practical recipes that you can quickly apply to your solutions. The recipes cover a broad range of topics including processing files, working with databases, understanding XML structures, integrating with Pentaho BI Suite, and more. Pentaho Data Integration 4 Cookbook shows you how to take advantage of all the aspects of Kettle through a set of practical recipes organized to find quick solutions to your needs. The initial chapters explain the details about working with databases, files, and XML structures. Then you will see different ways for searching data, executing and reusing jobs and transformations, and manipulating streams. Further, you will learn all the available options for integrating Kettle with other Pentaho tools. Pentaho Data Integration 4 Cookbook has plenty of recipes with easy step-by-step instructions to accomplish specific tasks. There are examples and code that are ready for adaptation to individual needs.
Table of Contents (17 chapters)
close
close
Pentaho Data Integration 4 Cookbook
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Preface
Index

Reading several files at the same time


Sometimes you have several files to read, all with the same structure, but different data. In this recipe, you will see how to read those files in a single step. The example uses a list of files containing names of museums in Italy.

Getting ready

You must have a group of text files in a directory, all with the same format. In this recipe, the names of these files start with museums_italy_ for example, museums_italy_1, museums_italy_2, museums_italy_roma, museums_italy_genova, and so on.

Each file has a list of names of museums, one museum on each line.

How to do it...

Carry out the following steps:

  1. Create a new transformation.

  2. Drop a Text file input step onto the work area.

  3. Under the File or directory tab, type the directory where the files are.

  4. In the Regular Expression textbox, type: museums_italy_.*\.txt

  5. Then click on the Add button. The grid will be populated, as shown in the following screenshot:

    Note

    ${Internal.Transformation.Filename.Directory} is a variable...

Unlock full access

Continue reading for free

A Packt free trial gives you instant online access to our library of over 7000 practical eBooks and videos, constantly updated with the latest in tech

Create a Note

Modal Close icon
You need to login to use this feature.
notes
bookmark search playlist font-size

Change the font size

margin-width

Change margin width

day-mode

Change background colour

Close icon Search
Country selected

Close icon Your notes and bookmarks

Delete Bookmark

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete

Delete Note

Modal Close icon
Are you sure you want to delete it?
Cancel
Yes, Delete

Edit Note

Modal Close icon
Write a note (max 255 characters)
Cancel
Update Note

Confirmation

Modal Close icon
claim successful

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY