Augment Analytics - Nous

Augment Analytics - Nous


1.Augmented Analytics -Nous 2.0

2. Top 10 Technology trends in 2019 Strategic Data and Analytics Augmented Analytics Augmented Data Management Continuous Intelligence Explainable AI Graph Data Fabric NLP/ Conversational Analytics Commercial AI and ML Blockchain Persistent Memory Servers Gartner

3.Top 10 Technology trends in 2020

4.Trend No. 1: Augmented analytics Augmented analytics automates finding and surfacing the most important insights or changes in the business to optimize decision making. It does this in a fraction of the time compared to manual approaches. Augmented analytics makes insights available to all business roles. While it reduces reliance on analytics, data science and machine learning experts, it will require increased data literacy across the organization. By 2020, augmented analytics will be a dominant driver of new purchases of analytics and business intelligence as well as data science and machine learning platforms.

5.Data to Analytics Challenge • Data preparation is huge effort • Data silos on different data platforms • Too many ad-hoc reports without single version of truth • Data Scientist is human, exhausted on repetitive work • A typical data analyst only analyzes a small portion (probably 10%)

6.Gartner Predicts: 2021 2022 75% of prebuilt reports Every personalized 30% of customer will be replaced with our interaction between interactions will be augmented by automated users and applications influenced by real-time insights delivered on a or devices will be location analysis, up “most needed” basis adaptive from 4% in 2017

7. - Powered by iBot Vision Augmented analytics product that automates insights for eBay business with nature language interface, powered by AI technology and Data Fabric

8. Value Easy Smart Fast Break technologies barriers Prebuilt reports are replaced Instant answer from entire for analytics with automated insights EDW Pushing more complex analytics Cross domains and platforms On-fly insight from metric workload away from the user data navigation ocean

9.Nous 2.0 in Augmented Analytics Stage 1: Data Discovery NLP Search Stage 2: Explorable KG Signal Detection Anomaly Detection Trending Stage 3: Actionable Insight Automated Causality analysis Stage 4: Analytics Everywhere Embedded Interactive

10.Overall Architecture Search Engine Insight Generator Data Governance BI Visualization API *NRP Knowledge Graph Data Processing Engine *Data Express Data Fabric

11.Overall Tech Stack

12.Overall Tech Stack

13.Knowledge Graph Logical Physical Average Page View Selling Price Count Finance GMV USD Kylin MySQL Structure Data Vertical Name Site Name Hive DW_SLNG_D DW_SITES LY_SD DW_LSTG_IT EM BSNS_VRTCL US _NAME P&A SITE_ID SITE_NAME

14.Knowledge Graph - Architecture

15.NLP Search Search metrics, data, cubes and tables as you would on Google • Nature language • Auto suggestion • Smart refinement • Trending recommendation



18.Architecture - Search Autocomplete Service NLP Parser Logic Query Engine Knowledge Graph Semantic Cache Metric Graph

19. Search Ranking Algorithm terms Structure input Label Negative m1d1v1 m1 Exampling Meta in KG Simulate m1 m3 d1 Train m1 … … … … Transform Nous Search Logs Feature generation & Model training terms structure score terms structure m*v* 1.0 Feature Generation Predict Online m*v* gmv on Parser Ranking m*v* 0.8 us site m*v* Model Pruner m*v* m*v* 0.6

20.Automated Insight • Outlier & Anomaly • Correlated Analysis • Causality detection

21.Outlier & Anomaly

22.Correlated analysis

23.Causality Detection

24.Insight Generator - Architecture Online Model Offline Model Anomaly Root cause Change Point Correlation Prediction Metric Embedding Data Express Knowledge Graph

25.Insight Generator Phase I Phase II Unsupervised model User Feedback + metrics • State space machine (local trend) • Bayesian change point detection INPUT • Time Series decomposition ENCODE R Anomaly Change Point Seasonal Trend Detection Detection Decomposition π Correlation Computation LAYTENT MERGE m Enhance the model LAYER 1 with semi- m supervised neural 4 networks DECODE m R m 5 2 m 3 OUTPUT Anomaly Detection Change Point Detection Seasonal Trend Decomposition

26.Self Service Reporting Build customized report with drag and drop experience


28.Data Exploration and Preparation 1.Data Navigation based on KG 2.Data auto preparation

29.Data Exploration and Preparation – Data Navigation “Sold item by country and city”

ebay中国研发中心(ebay CCOE)成立于2004年,是ebay最早也是迄今为止最大的海外研发中心,目前将近有800位优秀技术人才。公司主要从事云基础架构研发、大数据智能分析平台、大规模分布式计算研发,以及基于人工智能的搜索引擎、互联网广告投放和ebay的全球支付研发。