GemFire Enterprise Data FabricGemStone Systems Inc. Michael I Lazar, Federal Technology Director Michael.lazar@Gemstone.com 301 325 8405 Steve Rixse, Director Public Sector Steve.Rixse@Gemstone.com 301 664 8494
GemFire Enterprise Data Fabric
GemStone Systems Inc. Michael I Lazar, Federal Technology Director Michael.lazar@Gemstone.com 301 325 8405 Steve Rixse, Director Public Sector Steve.Rixse@Gemstone.com 301 664 8494
GemStone at a Glance
2 Founded 1982, with over 200 installed customers, in the Global 2000. Includes Bear Sterns, JP Morgan, Merrill Lynch, Northrop Grumman, NCI Unique and patented expertise in object management, high performance caching and data distribution technologies. Profitable, well funded and experienced management team. Office Locations - Beaverton OR, Santa Clara CA, New York City, Washington DC; 60% in R&D, 20 % in Sales and Marketing Dedicated Federal and Financial teams 24x7x365 global support.
1. Our heritage in object management, IP, etc. 2. Dedication to finance vertical 3. Our strong fiscal position compared to competitors 4. Operation capabilities to provide high QoS
What do we do ?
3 Distributed Operational Data Infrastructure Not just a distributed cache Key semantics of a database – ACID Key semantics of a Message bus Enable data sharing and event notifications At memory speeds Enable apps to continuously analyze and react to very fast moving data A Data Fabric for the Enterprise
Setting the context -- customers usually think of us as a distributed caching vendor -- we think we are the next generation operational data infrastructure … best of database semantics and messaging -- D caching is common --- use JBoss cache -- Focus areas: main memory distributed data management – scale/perf reliable data routing and messaging continuous data analysis – active database -- Recent traction from forrestor -- information fabric
What do we do - GemFire Value proposition
4 Enable notification of data changes to users and other applications Create framework for high performance data access Scale applications to meet unpredictable demands for information Boost performance across applications without increasing other hardware/software requirements Reduces network load and can work over low bandwidth networks Enhance the performance, scalability, and network characteristics of other software. Single product with multiple uses, easy to implement and little to no management requirements Standards compliant interfaces
Alert Notification as data changes in real time memory driven Application to memory to application vs. Application to disk to application Scaling today means more boxes and more licenses without creating an elastic fabric – queries and collaboration can drive today’s systems in the ground when some event arises NW load is an issue for your customers and deployed assets One product, multiple uses, multiple benefits! Cost savings
GemFire Enterprise
5 (GFE Java and GFE C++) A scalable and high-performance software data infrastructure that Caches and distributes data in multiple formats (Java, C++, XML) across distributed applications Connects to backend systems like databases, messaging systems, etc. Provides high data availability mechanisms Supports distributed transactions and standards-based querying Highly instrumented GemFire Real-Time Events In memory complex event processing (CEP) solution that facilitates agile, event-driven architectures by analyzing streams of data in conjunction with other static/historical data sources JDBC and SQL based, with Continuous Queries Client side materialized view Messaging paradigm with connected and disconnect clients Highly instrumented
EDF - Where Does it Fit?
6 High Availability Data Management Data Distribution Mainframes Historical Data Customer Data Enterprise Data Fabric Distributed Caching High Availability Custom Application Data Sources Event Processing Data distribution Data Modeling Data Access Application Access Analytics Portals Execution Reporting SQL XML Java C++/ C# Grid Computing SOA EDA
What is GemFire EDF - Key Features?
7 Analytics Portals Execution Reporting Virtualize data and events from many sources Manage and partition data in distributed main-memory for blazing performance Provide data access for applications in multiple formats to support heterogeneity High-speed data distribution (TCP/IP, Multicast) across multiple nodes - Move data on demand Replicate data to mirror nodes synchronously for high availability Overflow or persist to disk to scale to large data volumes and for data recovery Standards-based Querying and Continuous Querying on structured data and streaming data Distributed transactions for reliable operations Query Event Streams SQL XML Java C++/ C# Disk Grid Computing SOA Event-Processing ENTERPRISE DATA FABRIC
SOA – Composite Applications
8 GEMFIRE ENTERPRISE DATA FABRIC Java, C/C++/C#, XML:DB, SOAP Interfaces High Availability Data Management Data Distribution Transactions, Logging, Authentication, Discovery Session Management, Entitlements ESB Business Process Composite Applications: e.g,, Web Portals File systems Data Warehouses Databases Custom Application Data Sources Process State Authentication Session/Process State Management Reference data access XML Data Transformation
SOA - Composite Processes
9 Web Service 1 Composite Application Flow User/Process Web Service 2 Web Service 3 Web Service N Authentication Session State Management Reference data access XML Data Transformation GemFire Enterprise Web Service 1 Web Service 2 Web Service 3 Web Service N
SOA - Authentication
10 Web Service 1 Composite Application Flow User/Process Web Service 2 Web Service 3 Web Service N GemFire Enterprise Web Service 1 Web Service 2 Web Service 3 Web Service N Identify and Authenticate - Get Authorizations (IA&A) Travel over network Calls Policy Server/LDAP repository Calls RDBMS Repeat for each step in application flow Often more time than actual service step GemFire eliminates redundant lookups This is also used for Authentication Management for Enterprise Portals GFE
SOA - Session/Process State Management
11 Web Service 1 Composite Application Flow User/Process Web Service 2 Web Service 3 Web Service N GemFire Enterprise Web Service 1 Web Service 2 Web Service 3 Web Service N In SOA process state is either Returned as XML between steps Often stored by workflow manager in RDBMS Stored in RDBMS by state aware services GemFire removes latency introduced by network and RDBMS GemFire This is also used for Session State Management for Enterprise Portals
SOA – Reference Data
12 Web Service 1 Composite Application Flow User/Process Web Service 2 Web Service 3 Web Service N GemFire Enterprise Web Service 1 Web Service 2 Web Service 3 Web Service N Service calls back-end data source to look up same information over and over GemFire removes need to make redundant calls to back end
SOA – XML data transformation
13 Web Service 1 Composite Application Flow User/Process Web Service 2 Web Service 3 Web Service N GemFire Enterprise Web Service 1 Web Service 2 Web Service 3 Web Service N Service returns same information over and over (for a period of time) If it is called with the same request GemFire removes need to retrieve data from back end, and transform it into XML.
SOA – XML data transformation
14 Web Service 1 Composite Application Flow User/Process Web Service 2 Web Service 3 Web Service N GemFire Enterprise Web Service 1 Web Service 2 Web Service 3 Web Service N Service returns same information over and over (for a period of time) If it is called with the same request GemFire removes need to retrieve data from back end, and transform it into XML. GemFire also provides Optimized XML data representation Less Memory Less Java GC/overhead Optimized XML data access
GemFire Design Patterns
15 Application Survivability and Network Usage Reduction Web Browsers App Server Web Services Applications App Server or SOA applications Wide Area Network PDAs And Wireless Devices Wireless App Server GemFire Cache GemFire Cache
GF Real Time Events Functional Overview
16 Real-Time Data Streams GemFire Real-Time Events Continuously analyze (execute continuous queries on event streams) Identify patterns of interest through correlation with other data Selectively notify systems and personnel of relevant changes and updates in real-time Financial Markets Data Battlefield Information RFID Data Wireless Network Data Register Continuous Queries
Summary Highlights
17 Solve numerous challenges in SOA and distributed systems environments Enhance Scalability, Performance, Reliability of systems Potentially reduce hardware and software costs Easy to insert into new and existing systems Highly Available, Highly instrumented, Highly configurable NSA Acquisition Security approved
EDF - Key Technical Concepts
GemStone Systems Inc. This presentation contains information that is CONFIDENTIAL to GemStone Systems Inc. Do not distribute or copy this presentation without express written permission.
GemFire Enterprise
19 A scalable and high-performance data infrastructure that Caches and distributes data in multiple formats, across distributed applications Connects to backend systems like databases, messaging systems, etc. Provides high data availability mechanisms Supports distributed transactions and standards-based querying Offers interfaces for C/C++/C# applications as well Target Environments Java/J2EE based platforms XML/Web Services
GemFire Enterprise -- C++
20 An extremely high throughput and performance data infrastructure that Native C++ bindings to avoid inefficiencies Highly parallel distribution with optimized transport Avoids unnecessary user-kernel crossings with no contention or context-switching Connects to backend systems like databases, messaging systems, etc. Provides high data availability mechanisms Offers interfaces for Java applications as well (future) Target Environments C++ -based application environments Performance and throughput are primary concerns
Comments