What is Snowflake?
- Snowflake is the only data platform built for the cloud for all your data and all your users. Mobilize your data to advance your business.
Cloud Services — Manage and Maintain SaaS via simple Web Interface with above set of services.
Query Processing — Virtual Warehouse Cluster at Elastic scale,
Database Create, Modify, Delete
Schema Create , Modify, Delete.
Table, Procedures, Secure/Views & Functions Create , Modify, Delete. etc. features listed below.
Snowflake — Why Snowflake — High Return On Investment(ROI) to the IT Teams to manage and maintain Data on SaaS Cloud DataWarehouse…
I describe here to handle a large file which pass through kafka software and to avoid data loss from producer to server more than 1 MB and split large file into chunks and aggregate at consumer and finally process it.
Kafka Handling large messages : This is a challenging problem statement.
Kafka how it works?
KAFKA IS A LOG APPEND STRUCTURE FILE SYSTEM, EACH Data APPENDS TO TAIL OF THE FILE AND THEN BUILDS A SEGMENT in a specified file system path.
Please google out for more details about kafka software
Kafka High level Architecture
Kafka can be…
What is microservice?
An application decomposed into collection of loosely coupled services.
Microservice is a architectural style - It’s a variant of the service-oriented architecture (SOA) structural style.
Advantages of microservice over monolithic.
Services are fine-grained.
The protocols are lightweight.
Highly maintainable and testable.
Organized around business capabilities.
Who are all supported microservice implementation?
Spring Software Platform supports Microservice by using Spring Boot framework.(https://spring.io/)
Spring or Spark, etc. supports REST API services over HTTP transport.
HTTP operations like GET, POST, PUT, DELETE, etc.
Swagger is a OpenAPI standards product supports all authentication and…
DevOps means that Developer + Operations called DevOps.
In the software industry back to 2012 everything was developed using software engineering water fall model, and separate engineers assigned to work individual roles like developers: Develop a piece of code , operations: who builds, deploy, manage and maintains software infrastructure etc.
Now trend has changed in the software engineering process like v model, agile, rapid fast to develop, build and deploy software into the platform and make it available for business, this saves a lot time by business, and make use of developer time.
With the advent of new software’s, many…