Desenvolvimento de Aplicações Nativas da Nuvem com Arquitetura Baseada em Microservices

Sistemas de Informação, Centro de Informática, (UFPE)

Instrutores

Professor Vinicius Cardoso Garcia ([email protected])

Disciplinas

Pós-Graduação: IN1062 - Tópicos Avançados em Sistemas Distribuídos 3
Graduação: IF1007 - Tópicos Avançados em Sistemas de Informação 4

Local

Centro de Informática, horários: segunda (17:00-18:40) e quarta (18:50-20:30), sala E-112, Bloco E.
Aulas práticas, quando ocorrerem, serão no Lab G2 (preferencialmente).

Comunicação

Temos um canal no Telegram para uma comunicação mais dinâmica: Reliability Engineering Group Channel

Edições passadas

Semestre 2018.1

Ementa

Microservice é um estilo e padrão de arquitetura de software em que sistemas complexos são decompostos em serviços menores que trabalham em conjunto para formar serviços maiores. Os Microservices são serviços autônomos, independentes e independentemente implantáveis. No mundo de hoje, muitas empresas usam microservices como principal padrão para a construção de aplicativos corporativos grandes e orientados a serviços.

O framework Spring é um framework de programação popular com a comunidade de desenvolvedores por muitos anos. O Spring Boot removeu a necessidade de ter um conteiner leve de aplicação e forneceu um meio para implantar aplicativos leves e sem servidor. O Spring Cloud combina muitos componentes e junto com o OSS Netflix e fornece um ecossistema para executar e gerenciar microservices em grande escala. Ele fornece recursos como balanceamento de carga, registro de serviço, monitoramento, gateway de serviço e assim por diante.

No entanto, os microservices vêm com seus próprios desafios, como monitoramento, gerenciamento, distribuição, dimensionamento, descoberta, etc., especialmente quando se implanta em escala. A adoção de microservices sem abordar os desafios dos microservices comuns levaria a resultados catastróficos. A parte mais importante deste curso é discutir um modelo de capacidade de microservice agnóstico em termos de tecnologia que busca ajudar a resolver os desafios mais comuns do mundo de microservice.

Bibliografia Sugerida

Não há livro texto obrigatório. Entretanto, a seguir estão alguns livros que podem ser recomendados:

Building Microservices: Designing Fine-Grained Systems
LEWIS, J.; FOWLER, M. Microservices: a definition of this new architectural term. MartinFowler. com, v. 25, Mar 2014.
X. Larrucea, I. Santamaria, R. Colomo-Palacios and C. Ebert, "Microservices," in IEEE Software, vol. 35, no. 3, pp. 96-100, May/June 2018. doi: 10.1109/MS.2018.2141030
P. Jamshidi, C. Pahl, N. C. Mendonça, J. Lewis and S. Tilkov, "Microservices: The Journey So Far and Challenges Ahead," in IEEE Software, vol. 35, no. 3, pp. 24-35, May/June 2018. doi: 10.1109/MS.2018.2141039
The Architecture of Open Source Applications

Bibliografia Complementar

Bibliografia sobre Ferramentas, Frameworks e Tecnologias

Pattern: Monolithic Architecture
Pattern: Microservice Architecture
Introduction to Microservices, this is a seven‑part series of articles
How to Write Great API Documentation Every Time
Layering Microservices
Why Spring Boot is an Excellent Choice For Your Next Applications
10 Myths About Microservices, by Codonomics, Dec 23 - 2018.
10 Challenges and Solutions for Microservices — Tips and Tricks, by by Rajiv Srivastava, Jul 02 - 2018
Spring IO
- Spring IO Website: http://www.spring.io
- Spring Boot: https://projects.spring.io/spring-boot/
- Spring Cloud: https://projects.spring.io/spring-cloud/
- Spring Projects: http://spring.io/projects
- Spring Guides: http://spring.io/guides
- Spring Document: http://spring.io/guides
- Spring Boot Docs: http://docs.spring.io/spring-boot/docs/current/reference/htmlsingle/
- Spring Boot API: http://docs.spring.io/spring-boot/docs/current/api/
Stay Connected
- Twitter: http://twitter.com/springcentral
- YouTube: http://spring.io/video
- Questions: http://spring.io/questions
- JIRA: http://jira.spring.io
- Blog: http://spring.io/blog
Help
- Stack Overflow: http://stackoverflow.com/questions/tagged/spring-boot
Cloud Computing
- Public Cloud Services Comparison
Serverless Architecture
- Building a Serverless Microservice CRUD RESTful API with MongoDB, Richard Freeman, PhD, Jan 29 - 2019.
Service Mesh
- P. Jamshidi, C. Pahl, N. C. Mendonça, J. Lewis and S. Tilkov, "Microservices: The Journey So Far and Challenges Ahead", in IEEE Software, vol. 35, no. 3, pp. 24-35, May/June 2018.
- Pattern: Service Mesh, by Phil Calçado, Aug 3, 2017
- What’s a service mesh? And why do I need one?, by Willian Morgan, April 25, 2017
- The Enterprise Path to Service Mesh Architectures, O’Reilly Media, Inc., First Edition, 2018.
Netflix Open Source Software Center
The InfoQ eMag: Microservices vs. Monoliths - The Reality Beyond the Hype
The cloud native application: Microservices with Spring Boot and Spring Cloud
Production-Ready Microservices - Building Standardized Systems Across an Engineering Organization
Microservices vs. Service-Oriented Architecture
The Difference between SOA and Microservices?
Canary deployments, A/B testing, and microservices with Ambassador
Systems Performance: Enterprise and the Cloud
Designing Data-Intensive Applications
Continous Delivery
The Evolution of DevSecOps Revisited
Containers com Docker: Do desenvolvimento à produção
Ansible: Up and Running
WTF is Docker?, A brief explanation of Docker and Docker compose in English
Docker Tutorials and Labs (This repo contains Docker labs and tutorials authored both by Docker, and by members of the community)
Mike Coleman (Docker Employee) "Docker for the Virtualization Admin" eBook
What Is Containerization?, by Shaan RayFollow, Feb 5 - 2019.
Entrega contínua em Android: Como automatizar a distribuição de apps
Jenkins: Automatize tudo sem complicações
Testes automatizados de software: Um guia prático
Test-Driven Development: Teste e Design no Mundo Real
Cloud Computing: Concepts, Technology & Architecture
Four Layers of TCP/IP model, Comparison and Difference between TCP/IP and OSI models
Travis CI, Test and Deploy with Confidence
From open source to sustainable success: the Kubernetes graduation story
Kubernetes Ingress: NodePort, Load Balancers, and Ingress Controllers
Kubernetes best practices: Resource requests and limits
Package Management Basics: apt, yum, dnf, pkg (by Digital Ocean
Getting Started with Feign Client in Spring
Developing Microservices with Behavior Driven Development and Interface Oriented Design, by Kenneth Pugh -- Jan 26, 2019
The Future of Cloud Providers in Kubernetes, Authors: Andrew Sy Kim (VMware), Mike Crute (AWS), Walter Fender (Google) -- April 17, 2019

Blogs, Disciplinas, Treinamentos

Business Cases

Experiences Moving from Microservices to Workflows at Jet.com, by Jan Stenberg, Feb 14, 2019
Microservices after Two Years, by George Stocker, January 21, 2019
Monitoring containerized microservices with a centralized logging architecture. A case study of Project Horus, Sep 12, 2018.
The Smart Parking story - Part 1, Part2 and Part 3, Apr 12, 2018
Arquiteturas reativas e a experiência Mobile no Magazine Luiza, Jan 31, 2018.
Autorização de transações no Nubank: Consumindo serviços anos 80 com tecnologias atuais, Dec 06, 2017.
The Top 10 Adages in Continuous Deployment, by InfoQ on Sep 19, 2017
Spotify Lessons: Learning to Let Go of Machines, by James Wen on Sep 19, 2017
How we build microservices at Karma, Apr 4, 2016
Building Products at SoundCloud — Part I: Dealing with the Monolith, By Phil Calçado on June 11th, 2014
Building Products at SoundCloud—Part II: Breaking the Monolith, By Phil Calçado on June 12th, 2014
Preparing the Netflix API for Deployment, by Netflix Technology Blog on Nov 18, 2013
Continuous Deployment at IMVU: Doing the Impossible Fifty Times a Day, by Timothy Fitz on February 10, 2009
CA Technologies’ report gives some insights into business’ different understanding of DevOps and can be found at http://www.ca.com/us/collateral/white-papers/na/techinsights-report-what-smart-businesses-know-about-devops.aspx
XebiaLabs has a wide range of surveys and state of industry reports on DevOps-related topics that can be found at http://xebialabs.com/xl-resources/whitepapers/

Research Trends

Paolo Di Francesco, Patricia Lago, Ivano Malavolta, Architecting with microservices: A systematic mapping study, Journal of Systems and Software, Volume 150, 2019, Pages 77-97, ISSN 0164-1212, DOI: 10.1016/j.jss.2019.01.001.
O’Reilly Publishes “The State of Microservices Maturity” Report, by Reda Hmeid, Feb 3, 2019
Architecture and Design InfoQ Trends Report - January 2019, by Daniel Bryant & Thomas Betts & Charles Humble, Jan 24, 2019
Balalaie, A, Heydarnoori, A, Jamshidi, P, Tamburri, DA, Lynn, T. Microservices migration patterns. Softw Pract Exper. 2018; 48: 2019– 2042.
L. Chen, "Microservices: Architecting for Continuous Delivery and DevOps," 2018 IEEE International Conference on Software Architecture (ICSA), Seattle, WA, 2018, pp. 39-397. doi: 10.1109/ICSA.2018.00013
D. Guaman, L. Yaguachi, C. C. Samanta, J. H. Danilo and F. Soto, "Performance evaluation in the migration process from a monolithic application to microservices," 2018 13th Iberian Conference on Information Systems and Technologies (CISTI), Caceres, 2018, pp. 1-8. doi: 10.23919/CISTI.2018.8399148
Felipe Osses, Gastón Márquez, and Hernán Astudillo. 2018. Exploration of academic and industrial evidence about architectural tactics and patterns in microservices. In Proceedings of the 40th International Conference on Software Engineering: Companion Proceeedings (ICSE '18). ACM, New York, NY, USA, 256-257. DOI: 10.1145/3183440.3194958
Xili Wan, Xinjie Guan, Tianjing Wang, Guangwei Bai, Baek-Yong Choi, Application deployment using Microservice and Docker containers: Framework and optimization, Journal of Network and Computer Applications, Volume 119, 2018, Pages 97-109, ISSN 1084-8045.
Ricardo Colomo-Palacios, Eduardo Fernandes, Pedro Soto-Acosta, Xabier Larrucea, "A case analysis of enabling continuous software deployment through knowledge management", International Journal of Information Management, Volume 40, 2018, Pages 186-189, ISSN 0268-4012.
G. Pallis, D. Trihinas, A. Tryfonos and M. Dikaiakos, "DevOps as a Service: Pushing the Boundaries of Microservice Adoption," in IEEE Internet Computing, vol. 22, no. 3, pp. 65-71, May./Jun. 2018. doi: 10.1109/MIC.2018.032501519
D. Taibi and V. Lenarduzzi, "On the Definition of Microservice Bad Smells," in IEEE Software, vol. 35, no. 3, pp. 56-62, May/June 2018. doi: 10.1109/MS.2018.2141031
Chen, R., Li, S., & Li, Z. (2017). "From Monolith to Microservices: A Dataflow-Driven Approach". In 2017 24th Asia-Pacific Software Engineering Conference (APSEC) (Vol. 2017–Decem, pp. 466–475). IEEE. https://doi.org/10.1109/APSEC.2017.53
Viral Gupta, P.K. Kapur, Deepak Kumar, "Modeling and measuring attributes influencing DevOps implementation in an enterprise using structural equation modeling", Information and Software Technology, Volume 92, 2017, Pages 75-91, ISSN 0950-5849, https://doi.org/10.1016/j.infsof.2017.07.010.
D. Taibi and V. Lenarduzzi, "On the Definition of Microservice Bad Smells," in IEEE Software, vol. 35, no. 3, pp. 56-62, May/June 2018. doi: 10.1109/MS.2018.2141031
C. Barna, H. Khazaei, M. Fokaefs and M. Litoiu, "Delivering Elastic Containerized Cloud Applications to Enable DevOps," 2017 IEEE/ACM 12th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS), Buenos Aires, 2017, pp. 65-75. doi: 10.1109/SEAMS.2017.12
Nane Kratzke, Peter-Christian Quint, "Understanding cloud-native applications after 10 years of cloud computing - A systematic mapping study", Journal of Systems and Software, Volume 126, 2017, Pages 1-16, ISSN 0164-1212, https://doi.org/10.1016/j.jss.2017.01.001.
O'Connor, RV, Elger, P, Clarke, PM. "Continuous software engineering—A microservices architecture perspective". J Softw Evol Proc. 2017; 29: e1866. DOI: 10.1002/smr.1866
Garriga M. (2018) Towards a Taxonomy of Microservices Architectures. In: Cerone A., Roveri M. (eds) Software Engineering and Formal Methods. SEFM 2017. Lecture Notes in Computer Science, vol 10729. Springer, Cham
M. Waseem and P. Liang, "Microservices Architecture in DevOps," 2017 24th Asia-Pacific Software Engineering Conference Workshops (APSECW), Nanjing, 2017, pp. 13-14. doi: 10.1109/APSECW.2017.18.
Mazlami, G., Cito, J., & Leitner, P. (2017). "Extraction of Microservices from Monolithic Software Architectures". In 2017 IEEE International Conference on Web Services (ICWS) (pp. 524–531). IEEE. doi: 10.1109/ICWS.2017.61
Koschel, A., Astrova, I., & Dotterl, J. (2017). "Making the move to microservice architecture". In 2017 International Conference on Information Society (i-Society) (Vol. 2018–Janua, pp. 74–79). IEEE. doi: 10.23919/i-Society.2017.8354675
Bakshi, K. (2017). "Microservices-based software architecture and approaches". In 2017 IEEE Aerospace Conference (pp. 1–8). IEEE. doi: 10.1109/AERO.2017.7943959
M. Kassab, J. F. DeFranco and P. A. Laplante, "Software Testing: The State of the Practice," in IEEE Software, vol. 34, no. 5, pp. 46-52, 2017. doi: 10.1109/MS.2017.3571582
R. Valerdi, "Why Software Is Like Baseball," in IEEE Software, vol. 34, no. 5, pp. 7-9, 2017. doi: 10.1109/MS.2017.3571583
M. Kersten, "Value Stream Architecture," in IEEE Software, vol. 34, no. 5, pp. 10-12, 2017. doi: 10.1109/MS.2017.3571573
E. Woods, "Should Architects Code?," in IEEE Software, vol. 34, no. 5, pp. 20-21, 2017. doi: 10.1109/MS.2017.3571574
J. C. Carver, B. Penzenstadler, A. Serebrenik and A. Yamashita, "The Human Factor," in IEEE Software, vol. 34, no. 5, pp. 90-92, 2017. doi: 10.1109/MS.2017.3571580
K. Carter, "Francois Raynaud on DevSecOps," in IEEE Software, vol. 34, no. 5, pp. 93-96, 2017. doi: 10.1109/MS.2017.3571578
L. Zhu, L. Bass and G. Champlin-Scharff, "DevOps and Its Practices," in IEEE Software, vol. 33, no. 3, pp. 32-34, May-June 2016. doi: 10.1109/MS.2016.81
D. Jaramillo, D. V. Nguyen and R. Smart, "Leveraging microservices architecture by using Docker technology," SoutheastCon 2016, Norfolk, VA, 2016, pp. 1-5. doi: 10.1109/SECON.2016.7506647
T. Salah, M. Jamal Zemerly, Chan Yeob Yeun, M. Al-Qutayri and Y. Al-Hammadi, "The evolution of distributed systems towards microservices architecture," 2016 11th International Conference for Internet Technology and Secured Transactions (ICITST), Barcelona, 2016, pp. 318-325. doi: 10.1109/ICITST.2016.7856721.
N. Alshuqayran, N. Ali and R. Evans, "A Systematic Mapping Study in Microservice Architecture," 2016 IEEE 9th International Conference on Service-Oriented Computing and Applications (SOCA), Macau, 2016, pp. 44-51. doi: 10.1109/SOCA.2016.15.
Lin, J., Lin, L. C., & Huang, S. (2016). "Migrating web applications to clouds with microservice architectures". In 2016 International Conference on Applied System Innovation (ICASI) (pp. 1–4). IEEE. https://doi.org/10.1109/ICASI.2016.7539733 doi: 10.1109/SOCA.2016.15.
H. Kang, M. Le and S. Tao, "Container and Microservice Driven Design for Cloud Infrastructure DevOps," 2016 IEEE International Conference on Cloud Engineering (IC2E), Berlin, 2016, pp. 202-211. doi: 10.1109/IC2E.2016.26
A. Balalaie, A. Heydarnoori and P. Jamshidi, "Microservices Architecture Enables DevOps: Migration to a Cloud-Native Architecture," in IEEE Software, vol. 33, no. 3, pp. 42-52, 2016. doi:10.1109/MS.2016.64
Schermann G, Cito J, Leitner P, Zdun U, Gall H. 2016. An empirical study on principles and practices of continuous delivery and deployment. PeerJ Preprints 4:e1889v1. DOI: 10.7287/peerj.preprints.1889v1.
Balalaie A., Heydarnoori A., Jamshidi P. (2016) Migrating to Cloud-Native Architectures Using Microservices: An Experience Report. In: Celesti A., Leitner P. (eds) Advances in Service-Oriented and Cloud Computing. ESOCC 2015. Communications in Computer and Information Science, vol 567. Springer, Cham
Lwakatare L.E., Kuvaja P., Oivo M. (2015) "Dimensions of DevOps". In: Lassenius C., Dingsøyr T., Paasivaara M. (eds) Agile Processes in Software Engineering and Extreme Programming. XP 2015. Lecture Notes in Business Information Processing, vol 212. Springer, Cham

Objetivos

Espera-se que os alunos vivenciem exposição prática a ferramentas, processos e princípios do desenvolvimento de aplicações baseadas na arquitetura de microservices, juntamente com as boas práticas e técnicas de implantação nos princípios de DevOps e as vantagens e desafios do uso e imersão na Computação em Nuvem através de projetos práticos, enquanto compreendem modelos e ideias de pesquisa por trás das ferramentas e processos. As aulas incluirão experiências de aprendizagem no estilo de workshops, onde os alunos irão trabalhar em um problema e receberão comentários do professor, colaboradores convidados e outros colegas de classe. Quando possível, palestras convidadas da indústria ajudarão a ilustrar exemplos de como a tecnologia é implantada na prática.

Metodologia

Na disciplina, será utilizada uma mistura de aulas tradicionais com atividades e workshops em sala de aula. Durante as aulas, abordaremos conceitos básicos relacionados aos tópicos a serem tratados na disciplina. Durante os workshops em sala de aula, realizaremos exemplos de exercícios com ferramentas relevantes que reforçam o material de aula. As avaliações serão baseadas nas aulas, exercícios dirigidos, workshops e o projeto final.

Pré-Requisitos

Para participar deste curso é desejável que os participantes tenham:

Conhecimento básico de inglês técnico para leitura, estudo e acompanhamento das atividades propostas, uma vez que a maior parte do material disponível está em inglês.
Conhecimento básico de arquitetura de computador, sistemas operacionais, redes, engenharia de software e banco de dados.
Conhecimento de modelos de processo de desenvolvimento de software, em especial Metodologias Ágeis, testes de software. Conhecimento em TDD e BDD serão uma vantagem. Maiores informações podem ser consultadas no site da disciplina de Engenharia de Software (IF977).
Experiência em sistemas de computação, armazenamento, infraestruturas de rede e computação em nuvem será uma vantagem.

Avaliação

Projeto em equipe com até 3 membros [70%]
- Caráter puramente acadêmico e educacional. O projeto vai tratar de diversos aspectos do desenvolvimento de uma aplicação simples com arquitetura de microsserviços.
Observações:
- Entrega fora do prazo: redutor de 1 ponto por dia de atraso.
- Atraso máximo: 1 (uma) semana. Após esse prazo, será dada nota zero para a respectiva atividade de avaliação.
- Trabalhos com referências bibliográficas inconsistentes terão um redutor no conteúdo técnico.
- Trabalhos “CTRL-C + CTRL-V” terão nota zero (vale tanto para cópia de colegas, como para trabalhos copiados da internet).
Exercício Escolar Teórico Individual e/ou Atividades Práticas Individuais [30%]
- Exercício com questões objetivas
Como atividade de recuperação é proposta a aplicação de um Exercício Escolar abordando os temas apresentados e discutidos em classe.

Projetos

2018.1
- Equipe Porquin
- Equipe Scale
- Equipe CSD (Catalog Series and Drama) Service
- Equipe Horários acadêmicos
- Equipe Wyatt
- Equipe SWAN
- Equipe Hygieia Dashboard Clusterized on Kubernetes
- Equipe Cartola-MicroServices
- Equipe Greenhouse delivery
- Equipe HAUL-AWS

Recursos

Play with Docker: A simple, interactive and fun playground to learn Docker
Play with Kubernetes: A simple, interactive and fun playground to learn Kubernetes
Sock Shop: A Microservices Demo Application
Envoy Proxy: An Open Source Edge and Service Proxy, Designed for Cloud-Native Applications

Tópicos

Welcome, Methodology, Course Introduction (Core Topics)
Introduction to Microservices Concepts
Demystifying Microservices
Building Microservices with Spring Boot
Applying Microservices Concepts
Microservices Evolution – A Case Study
Scaling Microservices with Spring Cloud
Autoscaling Microservices
Logging and Monitoring Microservices
Containerizing Microservices with Docker
Managing Dockerized Microservices with Mesos and Marathon
Kubernetes orquestration enviroment
The Microservices Development Life Cycle

Plano de aulas 2019.1

#	Class	Topics	Assignments
01	Feb-18	Welcome, Methodology, Course Introduction (Core Topics)
02	Feb-20	Introduction to Microservices Concepts	HW1
03	Feb-25	Demystifying Microservices 1/2
04	Feb-27	Demystifying Microservices 2/2	HW2
05	Mar-11	Building Microservices with Spring Boot 1/2
06	Mar-13	Building Microservices with Spring Boot 2/2	HW3
07	Mar-18	Applying Microservices Concepts 1/2
08	Mar-20	Applying Microservices Concepts 1/2	HW4
09	Mar-25	Microservices Evolution – A Case Study 1/2
10	Mar-27	Microservices Evolution – A Case Study 2/2	HW5
11	Apr-01	Scaling Microservices with Spring Cloud 1/2
12	Apr-03	Scaling Microservices with Spring Cloud 2/2	HW6
13	Apr-08	Autoscaling Microservices 1/2
14	Apr-10	Autoscaling Microservices 2/2	HW7
15	Apr-15	Background: Operations (Chapter 3 from Len Bass' book)	HW9
16	Apr-17	The Deployment Pipeline (Chapter 4 from Len Bass' book)
17	Apr-22	Logging and Monitoring Microservices 1/2
18	Apr-24	Logging and Monitoring Microservices 2/2	HW8
19	Apr-29	Containerizing Microservices with Docker 1/2
20	May-06	Containerizing Microservices with Docker 2/2	HW11.1, HW11.2
21	May-08	Managing Dockerized Microservices with Mesos and Marathon 1/2
22	May-13	Managing Dockerized Microservices with Mesos and Marathon 2/2	HW12
23	May-15	Introduction to Kubernetes 1/2
24	May-20	Introduction to Kubernetes 2/2
25	May-22	The Microservices Development Life Cycle 1/2
26	May-27	The Microservices Development Life Cycle 2/2
27	May-29	Project execution time
28	Jun-03	Follow-up of project execution
29	Jun-05	Project execution time
30	Jun-10	Follow-up of project execution
31	Jun-12	Project execution time
32	Jun-17	Follow-up of project execution
33	Jun-19	Project presentation
34	Jun-26	Project presentation
35	Jul-01
36	Jul-03	Publication of final results

Disciplinas correlatas e/ou influenciadas

Após a iniciativa de construção desta disciplina, outras nasceram motivadas por este movimento ou inspiradas nos tópicos aqui cobertos. São elas:

Desmistificando DevOps: Projetando Arquiteturas Efetivamente Escaláveis, Prof. Vinicius Garcia, Centro de Informática - UFPE
Programação para a Web 2, Prof. Diego Pessoa, CST em Análise e Desenvolvimento de Sistemas, IFPB - Campus Cajazeiras

rjsr1 / if1007 Goto Github PK

if1007's Introduction