What is Snowflake?
- Snowflake is the only data platform built for the cloud for all your data and all your users. Mobilize your data to advance your business.

Snowflake Architecture

Snowflake Cloud DW

Cloud Services — Manage and Maintain SaaS via simple Web Interface with above set of services.

Query Processing Virtual Warehouse Cluster at Elastic scale,

Database Create, Modify, Delete

Schema Create , Modify, Delete.

Table, Procedures, Secure/Views & Functions Create , Modify, Delete. etc. features listed below.

Snowflake — Why Snowflake — High Return On Investment(ROI) to the IT Teams to manage and maintain Data on SaaS Cloud DataWarehouse…


I describe here to handle a large file which pass through kafka software and to avoid data loss from producer to server more than 1 MB and split large file into chunks and aggregate at consumer and finally process it.

Kafka Handling large messages : This is a challenging problem statement.

Kafka how it works?

KAFKA IS A LOG APPEND STRUCTURE FILE SYSTEM, EACH Data APPENDS TO TAIL OF THE FILE AND THEN BUILDS A SEGMENT in a specified file system path.

http://kafka.apache.org/

Note:
Please google out for more details about kafka software

Kafka High level Architecture

Kafka can be…


What is microservice?
An application decomposed into collection of loosely coupled services.

Microservice is a architectural style - It’s a variant of the service-oriented architecture (SOA) structural style.

Advantages of microservice over monolithic.

Services are fine-grained.
The protocols are lightweight.
Highly maintainable and testable.
Independently deployable.
Organized around business capabilities.

Who are all supported microservice implementation?

Spring Software Platform supports Microservice by using Spring Boot framework.(https://spring.io/)
Spark (http://sparkjava.com/)
JAX-RS (https://docs.oracle.com/javaee/6/tutorial/doc/giepu.html)
etc.
Spring or Spark, etc. supports REST API services over HTTP transport.
HTTP operations like GET, POST, PUT, DELETE, etc.

Swagger is a OpenAPI standards product supports all authentication and…


I am sharing here Power Point Presentation on Hadoop Architecture, Cluster, Capacity Plan.

Hadoop Components

How to user access hadoop machines

Hope that this will help us.


DevOps means that Developer + Operations called DevOps.

In the software industry back to 2012 everything was developed using software engineering water fall model, and separate engineers assigned to work individual roles like developers: Develop a piece of code , operations: who builds, deploy, manage and maintains software infrastructure etc.

Now trend has changed in the software engineering process like v model, agile, rapid fast to develop, build and deploy software into the platform and make it available for business, this saves a lot time by business, and make use of developer time.

With the advent of new software’s, many…

Narayana Basetty

Principal Cloud, Enterprise Web/HDP Architect/Consultant with 17+ years of experience building scalable, distributed computing solutions for an enterprise.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store