reveal.js

ArDeIm _v5

(Ar)chitecture, &
(De)sign, &
(Im)plementation

- A How-To journey from a Single Line Requirement to Release -

- Lay of the Land -

Heads UP!

Raise relevant questions to understand the business benefits!

- Be Open and Make No Assumptions -

What you think is what you get!

Specific & relevant details helps you think through a better solution!

- Stay Focused -

Prespectives & Concerns Differ!

Understand Business Needs vs Functionalities vs Implementation from the Stakeholder Perspective!

- Be an Enabler; Listen, Acknowledge & Accept Non Technical Needs! -

Context

Whew! So, What Next?

Next Steps

- Build Functionality first, then Iterate addressing the NFRs -

"Technology Next..." black

a new office panel
						narrator says whispering "Technology & NFRs?"
						kesiev with glasses using mac replies ".net - it has enterprise support, productivity & excellent tooling"
						lara looking left with mug says "Java - it's cross platform; fast, agile & portable"
						kesiev joined hands looking left says "MEAN - lightweight, fast development"

a new panic panel
						peter looking left using tablet replies "Choose the technologies for a purpose!"
						peter says "Quantify, Challenge & Measure Objectively!"

a new office panel
						kesiev same looking up says "What'd be the pro's & con's? Let's pick the best tech. stack suited to our needs."
						lara looking left winking thumb up says "Cool!"

a new panic panel
						peter looking left using tablet replies "Good grasp of at least one major programming language"
						peter same replies "a polyglot, preferably"
						peter same says "develop breadth, keep updated about industry news & developments"

- Fret Not! Help is not far! -

Data first, Design & Implementation follows next...

Core Concepts
	- TDD, BDD, DDD
Architecture & Design
	- Architectural Styles & Views
	- Technology Selection (How & Why)				
	- Polyglot DataStores
	- NFRs & Tradeoffs
Engineering 
	- Best Practices
	- Design Patterns
	- Design Principles (SOLID)
	- Code Smells
	- CI-CD & DevOPS first culture
	- Programming Paradigms (Functional, Imperative)

Core Concepts ...

Benefits of BDD
BDD Frameworks
Book: BDD in Action
BDD - Introduction from Dan North

TDD Example
Introduction to TDD

CQRS & Domain Driven Design
Awesome DDD - Nick Chamberlain
DDD Example
DDD Books
Domain Driven Design - Reference
The Ideal Domain-Driven Design Aggregate Store?
DDD & MicroServices

Architecture & Design ...

*** Remember All in One Box? (Slide 4.5)
NFRs / QA (Quality Attributes)

Layered Architecture

- Separation of Concerns - Simple Logical Decomposition, Top Down with Isolation -

Layered Architecture
N-Tier

Hexagonal Architecture

-Allow an application to equally be driven by users, programs, automated test or batch scripts, and to be developed and tested in isolation from its eventual run-time devices and databases-

Hexagonal Architecture
Hexagonal Architecture FAQ
Hexagonal Architecture Example #1
Hexagonal Architecture Example #2

CQRS

- Separate FLow for Queries (Reads) and Create (Writes) -

CQRS

Event Sourcing
MacDown logo

- Events are Immutable! There are no Updates & Deletes. Changes in state are stored as new events -

Event Sourcing Concept - Martin Fowler
Event Sourcing Example #1
Event Sourcing Example #2

Event Driven
MacDown logo

- Different Systems integrate using Domain Events -

Event Driven Architecture
Event Driven Data Management for Microservices
Event Driven Architecture - Example #1
Event Driven Architecture - Example #2 - Saga Pattern

MicroServices Architecture

- MicroServices are thin vertical slices of Business Functions
Independently Deployable and Scalable -

MicroServices Resource Guide
MicroServices (as defined by Martin Fowler)
Sam Newman on MicroServices!
MicroServices Architecture
MicroServices - What, When & How 
Chris Richardson on MicroServices
An Introduction to MicroServices from NGINX
(7 parts article series)

"Breaking down into manageable pieces - Functional Components" black

a new large office panel
						narrator says "...  next steps"
						kesiev is with glasses using mac at desk, looking right at lara and replies "We'd need the Page Design (UX)"
						kesiev same says "Less/Sass & Bootstrap?"
						lara joined hands looking left at kesiev replies "with Module/Component & Package Design!"

a new panic panel
						peter using tablet looking left says "different approaches - SPA, Server-Side page rendering (Javascript intensive) vs Conventional Server-Side Pages (Non-Javascript)"

a new very large office panel
						narrator says "(functional) PDP - to collate product, price & stock data"
						kesiev same says "wonder, how we'd get the data and render the page?"
						lara looking left with mug replies "Use MVC (Server-Side) / MVVM (Client-Side)"
						lara same says "And a template engine to render the views!"

a new panic panel
						peter using tablet looking left says "Understand frameworks, tools of the chosen tech. stack, languages"



Microsoft Patterns & Practices
Microsoft Application & Architecture Guide
Shaping Software - Architecture
Clean MicroService Architecture
Coding the Architecture
Software & Systems Architecture

Choose Polyglot DataStores for different data needs
MacDown logo

- RDBMS's for transactional needs (w replication), NoSQL for Scalability -

Microsoft Patterns & Practices - Data Guidance

Tips to choose the right data store based on the use case
MacDown logo

Tips to choose the right data store based on the type of data stored
MacDown logo

CAP Theorem
MacDown logo

- Choosing between Availability, Consistency & Partition Tolerance -

- Logical, Logical Connectivity Views -

yED from yWorks

- Physical View -

- Class & Sequence Diagrams -

PlantUML for Declarative diagrams
UML Simplified
ArgoUML
UMLet

Engineering ...

Follow Alistair Cockburn - Agile & Engineering Guru!
Microsoft Engineering Best Practices & Guidance

Software Paradigms
MacDown logo

OOPS!

	A Practical Intro to Functional Programming

"Design Patterns - Fine grained, class level solution to a problem in a particular context" black

a new office panel
						narrator says "...  Creational"
						kesiev using mac with glasses looking right to lara says "Builder, Factory, Abstract Factory..."
						lara looking left with joined hands replies "and there's Singleton, Prototype!"
						lara same says "CP's make object creation & management decoupled"

a new office panel
						narrator says "...  Structural"
						kesiev same says "Adapter, Proxy, Decorator, Facade..."
						lara looking left with joined hands replies "Bridge, Composite & the unique Flyweight!"
						lara same says "SP's help to organize and structure objects"

a new office panel
						narrator says "...  Behavioral"
						kesiev same says "Observer, Strategy, CoR, Command, Visitor..."
						lara looking left with joined hands replies "Iterator, State(FSM), Interpreter, Mediator, Memento & Template Method!"
						lara same says "BP's help to manage algo., control execution flow, streamline relationships & responsibilities of objects"

a new panic panel
						peter looking left using tablet replies "DP's are proven solutions for similar problems; Help communicate designs to other devs. easier"
						peter same says "btw, you can see patterns abiding and applying the design principles"

Design Patterns

Design Patterns Catalog
Patterns & Principles w Examples - Exhaustive List

"Design Principles" black 
	
							a new very large office panel
							narrator says "In the beginning there were ..."
							kesiev with glasses looking up using mac says "High Cohesion"
							lara looking left with mug replies "and Low Coupling"
	
							a new very large office panel
							narrator says "and then came SOLID"
							kesiev same says "SRP - Single Responsibility Principle"
							kesiev same replies "OCP - Open Closed Principle"
							lara same replies "ISP - Interface Segregation Principle"
							kesiev same says "LSP - Liskhov Substitution Principle"
							lara same says "IOC/DI - Inversion of Control"
							
							a new office panel
							narrator says "...  YAGNI, DRY, SLAP"
							kesiev same says "YAGNI - You Ain't Gonna Need It'"
							lara same replies "DRY - Don't Repeat Yourself'"
	
							a new panic panel
							peter looking left using tablet replies "Always code as if the guy who ends up maintaining your code will be a violent psychopath who knows where you live"

Principles Wiki

NFR's : Quality....

Clean Code Cheatsheet
Software Craftsmanship
Essential Programming Books - Bibles
Influential CS Books
Code Smells

"SCM, CI/CD" black

a new office panel
						narrator says "build, test, deploy - and automate 'em all'"
						kesiev using mac with glasses looking right to lara says "why build automation?"
						lara looking left with mug replies "faster time to market"
						lara same replies "deliver changes to production safely and quickly in a sustainable way"

a new very large office panel
						narrator says "Tools of the trade"
						kesiev same says "GIT, Jenkins, Chef, Ansible"
						lara same says "Trigger jenkinks builds on checkin to GIT"
						lara same says "run unit, acceptance tests after sucessful build from jenkins"
						lara same replies "and deploy to dev./test environment"

a new office panel
						kesiev same says to self "Canary Releases / Blue Green Deployment"
						lara same says "with least distruption to the environments" 
						
						a new very large panic panel
						peter looking left using tablet replies "repeat the test & deploy across staging, ppe, prod"

NFR's : Performance

Performance Testing
Awesome Web Performance Optimization
Path To Performance - Podcast

"How to improve performance" black

a new office panel
						narrator says "at an architectural level - across layers : caching"
						kesiev using mac looking right with glasses says "local or distributed?"
						lara looking left with mug replies "distributed for consistent data"
						lara same replies "local leads to stale data"

a new very large office panel
						narrator says "static & dynamic content"
						kesiev same says "use CDN for static"
						lara same replies "use distributed caches for optmizing reads - cache what doesn't change frequently"
						lara same says "Apache ignite, Redis, Hazelecast, MemCached, AppFabric etc."

a new blank panel
						narrator says "types of payloads - performance optimizations"
						kesiev same says "JSON, XML is not efficient when sizes are more!"
						lara same says "Apache Thrift, Avaro or Google ProtoBuf are perfect for large sizes"
						lara same says "They provide efficient data marshelling & reduce the size"
						
						a new panic panel
						peter using tablet looking left says "Don't forget to leverage the language specific constructs & features for optimization!"

C# Internals
C# async/await
CLR via C#
Java Performance Tuning

Concurrency vs Parallelism
Threading in C#

Grokking Algorithms!

A Beginners guide to big-o-notation
Big-O notation in 5 minutes — The basics
Big O Notation explained
Big O Notation: A Few Examples
Big O CheatSheet
Algorithms for dummies
Algorithimic Complexity
Understanding Big O

NFR's : Scalability

Awesome Scalability
Microsoft Improving Perfmormance & Scalability

- Revisiting DB Scaling & CAP -

NFR's : HA & Reliability

Scalability & HA go hand in hand!
HA Calls for more than one server;
An Active / Active HA cannot be possible without either Scale UP or Scale Out

Master Slave (Active / Passive)

Master Slave : Peer - Peer (Active / Active)

Sharding a NoSQL Database (Partition Data to manage scale)

Replication set (Active / Active, Active / Passive)

NFR's : Securing the System

"Security across layers" black

a new office panel
						narrator says "Security is an Ocean in itself!" 
						kesiev with glasses using mac looking up says "Reverse Proxies"
						kesiev same says "Internal & External Security"
						lara looking up with mug says "Authentication & Authorization"
						lara same replies "JWT, OAuth, HTTPS"

a new office panel
						kesiev same says "Mechanisms to prevemnt DDOS attacks" 
						kesive same replies "Vulnerability & PEN testing"

a new office panel
						lara same replies "Each and every layer should be secure! Breaches should be contained in same level!"
						lara same says "Build a DMZ - the ONLY layer accessible over the internet"

a new office panel
						lara same says "Whitelist well known consumers"
						lara same replies "Use Reverse proxies to prevent exposing actual servers & for redirection"
						lara same says "Open ONLY the ports that are needed"

a new panic panel
						peter looking left using tablet replies "Keep the layers locked & allow top down, unidirectional access between layers"

Microsoft Patterns & Practices Guidance - Security						
Microsoft Web Application Security: Threats and Countermeasures
Azure Security
OWASP
Vulnerability Testing vs Penetration Testing

Operational needs

JConsole
VisualVM - All in One Java troubleshooting tool
JRockit Mission Control
Debugging .Net Framework Apps

Links

Donne Martin's System Design Primer

- The Single Most absolute reference and
superbly organized collection of resources for system design -

Sources every engineer & architect should follow!

InfoQ Tech. Hub
High Scalability - Real Time Architectures
DZone Tech. Hub
HackerNoon - Bleeding edge of tech.
Hacker News

There's much much more, and these links give you good starting points

NetFlix OSS
Everything about MicroServices
Cloud Foundry
Cloud Native Computing Foundation
A curated list of awesome resources 
Foundations of Software Engineering
System Design Inputs
Awesome Software Craftsmanship
Awesome BigData - All about data stores & databases
Microservice Patterns

Contributors

Authors:
SivaramaSundar _{Concept, Storyboard, Content}

Karthik Kalkur _{- v1 - Arch. Styles, NoSQL; Reviews}
Suresh Balasubramaniam _{- v3, v4 - Reviews; Restructuring}
Thanu Sunderasan _{- v3, v4 - Reviews; Restructuring}
Manas Ranjan Dash _{Reviews & Debates}
Amit Saluja _{Reviews & Debates}

Inspiration & Support:
Rashmi Subbanna
Ashwini Karumbaiah
Rajat Pandit

Credits:
reveal.js _{JS Presentation Framework}
stripthis (kesiev) _{JS Comic Framework}

License:
MIT

ArDeIm v5

(Ar)chitecture, & (De)sign, & (Im)plementation