Degree | Type | Year | Semester |
---|---|---|---|
4313136 Modelling for Science and Engineering | OT | 0 | 1 |
It is recommended to have a basic knowledge of programming languages like Python and basic skills of any Linux distribution.
The objectives of the module:
-Solve data analysis problems with open source tools: Linux, Mysql, Spark
-Understand tool data management limitations and learn criteria to select suitable tools for a specific problem
-Learn data query methodologies related to each technology
-Use Cloud Computing providers to solve data analysis problems
-Apply a data analysis methodology to solve practical problems
By the end of the lectures and practical labs students should have enough knowledge to understand the requirements of typical large data analysis problems in industrial contexts. They should be able to pick some combination of tools and design a solution for a given large data analysis problem. This subject is oriented to develop data problem solving skills. Languages, tools and techniques are described in a data analysis context and students will solve a list of data problems applying the technology described at every chapter.
T1: Introduction to Distributed Systems and large data processing systems (4 hours)
T2: Linux data processing tools and workflow management (10 hours)
T3: Relational databases and data processing with MySQL (8 hours)
T4: Data parallel processing with Apache distributed tools (10 hours)
T5: Cloud computing (4 hours)
The methodology will combine classroom work and problem solving in laboratory sessions. This planned methodology and proposed assessment could be modified depending on restrictions on physical attendance to University classrooms due to health measures.
Virtual classes and labs will take place in a class Teams virtual space where all students will be invited to access. Lab sessions will be scheduled at the beginning of the course and will use the same Teams space for the development of all practical labs. Students will use a local Linux environment: native, using VirtualBox or using a Cloud Computing instance.
Title | Hours | ECTS | Learning Outcomes |
---|---|---|---|
Type: Directed | |||
Laboratory | 24 | 0.96 | 2, 1, 4, 8, 5, 9 |
Lectures | 38 | 1.52 | 2, 1, 7, 6, 8, 3, 9 |
Type: Autonomous | |||
Practical exercise development | 62 | 2.48 | 2, 1, 8, 5 |
Evaluation will come out from the combination of work developed in the lab sessions and a final exam.
Title | Weighting | Hours | ECTS | Learning Outcomes |
---|---|---|---|---|
Cloud Computing lab | 10% | 4 | 0.16 | 2, 7, 8 |
Exam | 30% | 2 | 0.08 | 2, 1, 4, 9 |
Linux lab | 20% | 6 | 0.24 | 2, 7, 8, 5 |
Mysql lab | 20% | 6 | 0.24 | 2, 1, 7, 6, 8, 3, 9 |
Spark lab | 20% | 8 | 0.32 | 2, 1, 7, 8, 3, 9 |
A. Wittig, M. Wittig. "Amazon Web Services in Action", Manning, 2nd Edition, 2018.
G. Coulouris, J. Dollimore and T. Kinderg, "Distributed Systems. Concepts and design ", Addison-Wesley, 5th edition, 2012.
Bell, Charles; Kindahl, Mats; Thalmann, Lars. "MySQL High Availability". O'Reilly, 2010.
Chang, Fay, et al. "Bigtable: A Distributed Storage System for Structured Data." OSDI, 2006
Dewitt, David, and Jim Gray. "Parallel Database Systems: The Future of High Performance Database Processing." Communications of the ACM 35, no. 6 (1992): 85-98
Schwartz, Baron; Zaitsev, Peter; Tkachenko, Vadim; Zawodny, Jeremy D.; Lentz, Arjen; Balling, Derek J. "High Performance MySQL", O'Reilly, 2008.
Seyed M. M. "Saied" Tahaghoghi and Hugh E. Williams. Learning MySQL. O’Reilly, 2006
Nathan Haines. “Beginning Ubuntu for Windows and Mac Users”. Apress 2015. Available as electronic resource at UAB library
William E. Shotts. “The Linux Command Line”. Second Internet Edition. 2013. http://linuxcommand.org/tlcl.php
Petar Zecevic, Marko Bonaci. “Spark in Action”. First Edition. Manning. 2017
V. Layka, D. Pollak. “Beginning Scala”. Apress. 2015. Available as electronic resource at UAB library
Dan C. Marinescu. “Cloud Computing. Theory and Practice”. Morgan-Kaufmann. 2018.
R. Buyya, R. N. Calheiros, A. V. Dastjerdi. “Big data. Principles and paradigms”. Morgan-Kaufmann. 2016.