Middleware to Alleviate Database Pressure

esProc is the middleware designed specifically to undertake the computing jobs between database and application. For the application, esProc provides the easy-to-use JDBC interface; For the database, esProc is powerful in parallel computing. By implementing the computing outside the database and in external storage, esProc alleviates the computing, storage and concurrency pressure on the database; effectively cuts down the cost of database software and hardware; and greatly optimizes database management.

 

Alleviating computing pressure. Too much computing will occupy a lot of CPU utilization and memory resources of the database server. Such cases include the data-intensive computing and computation-intensive tasks involving only a small amount of data. Consequently, long response time will deteriorate user experience and the overloading will shorten the life of the server. esProc has a complete and well-defined computing system, making it fully capable of sharing the workload for the database, and easily undertake various computing tasks, difficulty or easy, from the application. In addition, esProc supports parallel computing across multiple nodes, enabling it to equally distribute the task involving massive data or computations to multiple average servers or inexpensive PCs. In this way, users can achieve an overall outstanding performance much more superior to database servers while keeping a far lower provision of node hardware than that of the database servers.

Alleviating storage pressure. For the sake of safety, performance and usability, all kinds of application systems will not manipulate the core business data directly. Instead, the core business data will be processed into the form of temporary table/intermediate table for the direct use by application. Such redundant data and the associated SP would occupy a great many of storage spaces in the database, resulting in great storage pressure on database. esProc features the mechanism of external memory computing, which stores the intermediate database data into files on inexpensive HDDs and thus remove the need for database storage spaces. Through esProc JDBC, applications can access to the data stored in external storages and perform the standard structured data operations like query, compute, and modify. esProc also supports the external storage file retrieval and write-back to HDFS, which has a much greater storage space than that of any high capacity database.

Alleviating concurrency pressure. The enterprise level report applications or Web applications generally involve a great number of concurrent accesses and ultimately incur great pressure on database, which would reject the computing requests from users because all connection quotas have been used up. On the one hand, it is an effective and expensive means to solve the problem by upgrading the database hardware and buying more user licenses. On the other hand, limiting the number of concurrent connections and reducing the response will cut down the database cost while compromising the user experience and productivity. esProc solves the dilemma that the database cost can be lowered while alleviating the pressure of concurrency on database by supporting the parallel computing. The compute-intensive task can now be equally divided and allocated to multiple average PCs. Each node only needs to undertake a small amount of computing jobs.

Data administration tree. A database is a flat directory structure where all data tables are placed together linearly. Such situation is also true with SP. What’s worse, the intermediate table and its corresponding SP can only be stored separately in different directories. The flat directory structure is the root of disorder in data management/permission and application management. The public and private SPs become entangled and the intermediate tables for the sales or the production application get messed up. By comparison, esProc features the trouble-free external memory computing that manages source files and script files with an organized file system in a directory tree, where data can be placed in different directories according to the category and hierarchy and various sub-directories will be arranged for various modules, names of directories clearly indicate and differentiate the data from the new and the legacy systems, the script file and its source data can be stored in the same place, and the import, export, backup and recovery can be done with several simple actions of copy & paste. With esProc, data management becomes simple and clear.

Cutting database cost. With esProc users can store the core data in the database, with relatively low cost in management and hardware and fewer user licenses for maintaining and calculating important data and security management. The intermediate tables and script files derived from the core data are all stored outside the database. By doing so, the high-concurrency, big data parallel computing can be implemented on the inexpensive PCs. The data expansion can be solved easily with the HDFS and inexpensive HDDs. By reasonably leverage resources, the workload pressure on database can be significantly reduced, and database cost kept under control, management problems solved effectively, and various database applications handled with ease. These applications include the real-time high performance application, non-real-time big data application, desktop BI, report application, and ETL.

esProc enables users to write codes following natural thinking straightforwardly, not having to change their train of thoughts in converting the complex business logics into practical codes. To complete the same computing, esProc is several timesmore neat and concise than Java and SQL. ...
esProc is specialized incomputing from various different data sources, and the computing result can be written back to multiple or single data source. esProc ont only supports the rational database, MongoDB, Cassandra,and other NoSQL database, but also provides a great many functions to handle the structureddata and the semi-structureddata computing....
esProc supports the multi-thread computing on single node and parallel computing on multiple nodes without center. The big data can be divided into several small data blocks, then used in multiple node machine for parallel computing, and lastly merging andcomputing....
esProc optimizes the syntax for the structureddata, supports the in-memory computing and ordered set, and enables programmers to select the optimized path based on the characteristics of data and algorithms. The actual measured data indicates that the performance of esProc is close or even higher than that of database for the standalone machine. ...
esProc is the pure Java product, with the outstanding integration capablity by nature. esProc can be divided into four sections: JDBC, Command line, Server, and IDE. The JDBC is the specific calling interface for applications. The invoking method of esProc JDBC is similar to the stored procedure of normal database, i.e....
esProc is a data computing language with the powerful TSeq and cursor data object. It is especially optimized for the computing over (semi) structureddata, and capable of handling various complex computing problems easily. Because it is designed to serve the sole purpose of computing, esProc is simply structured and easy to grasp. ...
esProc is designed for application programmers to handle computing strongly related to the typical and complex business facts. Without any inheriting, overload, and other complex concepts, it is a development language neither object-oriented, nor fit for developing the infrastructure or the whole tool software. ...
Reorganization of the report data source: esProc is especially fit for the computing involving the complex business algorithm of data sources or the cross-database computing involving multiple data sources....
esProc is the professional database computing script, featuring the intuitive grid-style code. Without difining the temporary variables, users can reference the intermediate computing result with the cell name. By taking this advantage, users can implement the step-by-step computing easily. ...
esProc comprises four parts: IDE, JDBC, Command Line, and Server. esProc can run in JDK1.6 and above environments across platforms independently, not relying on other servers or middle ware. ...
Here are some screen shots for you to have a deeper insight on our product, include Cellset-style Script , SQL Execution and Data Structure Display, Program Debugging ,Computation Presentation etc...
1
According to the contract table in database, compute in a Java application: Monthly top N quality customers on sales amount in a specified year....
2
Take esProc as the computing layer for Java to find out: Customers who have bought the specified product. There are two tables in database. Part of the data is as below. The main train of thought is:...
3
The order data of customer is in ERP system and the customer information is stored in CRM system. Now we need to create a report to present the annual sales amount of each customer and the growth rate compared with the previous year. And the optional reporting tool only supports...
4
Find out staffs with the highest sales amount in various promotional periods according to the original data in the database. There are two tables, SaleRecord and Promotion. From Promotion table we can...
Continuous Relational Query
esProc supports using dissociative records as variables, thus enables users to make full use of the intermediate results.
  1. Dissociative record
  2. Record set storage
  3. Progressive query
Serial Number Related Query
esProc is very good at order and position related computing with the record set originally ordered.
  1. Median
  2. Select subset according to the position
  3. Compare over the previous period for selected records
  4. Select rows from the group subset
Readability of Syntax
The grid-style script of esProc displays the data intuitively and neatly. Meanwhile, esProc provides various unique functions to easily deal with varied complex queries.
  1. Constant sets
  2. Find records with the maximum and the minimum
  3. Sort by specified order
  4. Group rows by the specified order
  5. Overlapped conditional groups
Complex Queries in Steps
With step by step computing and program logics, esProc allows users to get results according to users' understandable process.
  1. Filter accumulated value
  2. Compare over the previous period for consecutive intervals
  3. Compute cross rows in group subset
  4. Progressively complete the result set
Set-operation Related Queries
esProc supports complete set-lizing operation enabling users towrite codes following their natural thought pattern.
  1. Filter the groups
  2. Sort the groupings
  3. Select a group subset
  4. Sort and filter the group subset
Relational Query with Multiple Tables
esProc supports union of data sets with different data structure, bringing simpler coding and computing.
  1. Union tables with different structure
  2. Reference of the record associated by foreign key
  3. Query the subtable
  4. Group the subtables

Contact us   today to  discuss  your esProc solution or  Download esProc  
esCalc leads to the computing capacity revolution for spreadsheets. It can easily solve problems which are difficult for traditional spreadsheets, such as: automatic formula copy in related cell, formula automatic migration between multi-layers tables, associated join between multiple tables.

esCalc realizes real visualization of data computation. Computations such as query, grouping, sorting, ranking, delete, table joins, filter for duplicates, which can only be completed previously by abstract scripts like SQL statements, R language, esProc scripts, can now be achieved by buttons/menus as long as concrete data is given.

With esCalc, business users can independently conduct a range of business intelligence computation on desktop, analyze data agilely in rapidly changing business opportunities and make quick decisions. esCalc is self-service professional reporting tool, more intelligent spreadsheet, data calculator for business users and secondary processing tool for reports.

esCalc keeps the basic functions and using style of spreadsheet, but is completely beyond traditional spreadsheet on complex tabular data calculation. Traditional spreadsheet lacks the capacity of integral calculation on business data, for example, when pasting a formula, other spreadsheets only permit adjustment of relative position, resulting in a business rule violation, while adjustment with esCalc can be finished automatically and intelligently focusing...
esCalc enables abstract and complicated data computing to be more concrete and visible. The computing which needs script writing with SQL Statement, R language, esProc script, etc., now can be easily done through visual operation. First, users' operation objects are not abstract data structure but the specific business data; then users can select the operational actions from the menu, such as, query, group, sort, filter, rank, join, union, etc., corresponding...
The traditional reporting tools usually need higher technical requirements, such as retrieving script, complex report expressions, and abstract logic. While with esCalc, users can complete the entire report independently without technical background.
First, esCalc provides retrieving data UI to guide static data extraction from the database, Excel or text files. Second, its ease-of-use and traditional Excel-style user interface allows business users...
Business users can use esCalc to conduct a serial of business intelligence computing on their desktop.
esCalc is professional reporting tool with capability of creating various tables and graphs. This more powerful spreadsheet has a more intelligent table calculation engine. With visible operation, esCalc can realize the corresponding functions of SQL without writing scripts since it is visualized data computing tool. esCalc can be used as the calculator of...
Capable to reference the data from database or external files such as txt and Excel. Capable to perform the copy, paste, and other operations to edit the cellset data. Intuitive interface for report preparation. Capable to be saved as various formats like txt, xls, and gex to facilitate the use and edit...
Through the level settings, rows are associated to each other. The multi-level structure can describe the data in the real business more completely. Free and convenient grouping operation with outstanding performance and the usage is quite simple. It is the real grouping that you can sort, filter, and perform other operations on each group and the data ...
The data with the same business priority will be set in the homorow. The appearance property of homocell in the homorow will be processed concurrently. Through the formula migration of homocell, calculations of the same business logic will be completed all at once. Given the below table of the technical data of pitchers of some baseball teams ...
Utilize the settings of homorow and level, recognize the true objective of computation smartly. The formula in homocell will be auto-migrated, no need to copy and paste. In the below table, given the statistics of the most frequently used surnames in some countries, calculate the proportion taken by the total population of people with this surname in each region ...
Full support for sets, and capable to handle the sum, subtraction, intersection, union, and other operations on sets directly. The sets exist in the form of object, making the summarization more intuitive and easy to read and write. Given the score statistics for the last three games of a certain basketball team, make statistics on players whose scores are among ...
Stepwise operation to solve the complicated problem progressively. Instant presenting the result, intuitive, and easy-to-use. Given the payroll of a company below, select out the male employees of which the wage are higher than that of any female employee in their department. ...
Handle the multi-level join automatically according to the level and master cell settings. Operation style is similar to the copy & paste, convenient and intuitive. In the below table, there is the population data of some states and the abbreviations are set as the master cell ...
As a desktop BI tool, esCalc is specialized in various data process from database, text, and Excel files. It is user friendly, easy to install and use, and does not require high technical background. esCalc can operation functions like locate, filter, sort, group, align, join and union through menu to complete various complex data analysis between multiple tables. ...
Data analysis and report preparation are widely required practically in business for the management of inventory, sales, and human resources, etc.,like the statistics on the client and sales data. It's essencial for users to realize self-analyzing and self-reporting. Spreadsheet is the most widely used desktop data process software, but the traditional spreadsheet lacks the ability of computing the complex analysis...
esCalc has implemented the complete set-lization for you to conveniently perform the set operations, such as intersection, complement, and union.With the multi-level structure, the practical business can be described in a better way to implement the real grouping. Based on the multi-level structure, various data file can be associated to implement the join and union ...
Rich and perfect format setup and pagination features to support various charts.Excel-style interface for easier report design and more convenient operation.Rich data analysis features to complete various analysis operations like statistics, grouping, sorting, and filtering. System Requirements...
Here are some screen shots for you to have a deeper insight on our product, include Cellset-style Script , SQL Execution and Data Structure Display, Program Debugging ,Computation Presentation etc...
Compute the top 3 clients by order value according to the detailed order data. The basic train of thought is to group the orders by clients firstly, secondly sum up...
Given a book of 3 Excel sheets in which there is the basic salary, attendance record, and performance data, we now need to compute the actual salary of employee. When computing, use the below formula: Payable weekly salary = standard weekly salary *(1+Performance...
On the basis of a database of the sales data of a pharmaceutical company in the recent 2 years, make statistics on the year-on-year monthly and the link relative ratio comparisons for each product. In which, the link relative ration comparison refers to the monthly...

Contact ustoday to discuss your esCalc solution or Download esCalc