1 .How Neural Networks See Social Networks Daniel Darabos, Janos Maginecz #DLSAIS11 

2 .Context Lynx does social network analytics for telcos & others. We use graph convolutional neural networks. Good predictions of missing data and future behavior. We want to understand how the network does it. #DLSAIS11 2 

3 .Graph Convolutional Network #DLSAIS11 3 

4 .input network prediction #DLSAIS11 4 

5 . repeat n times state new state input network prediction #DLSAIS11 5 

6 . repeat n times state new state vertex features network for each known vertex labels prediction neighbor vertex state edges #DLSAIS11 6 

7 .“Neural Network That Learns From a Huge Graph” Spark Summit East 2017 #DLSAIS11 7 

8 .Running Examples #DLSAIS11 8 

9 .complete real data network prediction #DLSAIS11 9 

10 . ✔ Validated against ✔ known labels ARTIAL real data Pcomplete network prediction #DLSAIS11 10 

11 . ✔ Validated against ✔ known labels ARTIAL real data Pcomplete network prediction attribution & feature explanation visualization #DLSAIS11 11 

12 . ✔ Validated against ✔ known labels t he t ic complete real data network prediction syn ✔ Validated against ✔ known rules attribution & feature explanation visualization #DLSAIS11 12 

13 .Running example: Three Friends Real social network edges. positive Synthetic features: random “talent”, 0–1. Synthetic labels: “three friends are rockstars” or not. “rockstar” means “talent” > θ rockstar #DLSAIS11 13 

14 . node rockstar color is class subject node #DLSAIS11 14 

15 . direct neighbor Running example: Friends of Friends rockstar Real social network edges. Synthetic features: random “talent”, 0–1. Synthetic labels: “distance to a rockstar is 2” or not. “rockstar” means “talent” > θ positive #DLSAIS11 15 

16 .Running example: age prediction 10–20 Real social network edges. 29–69 No features. Real labels: age bucket (4 equal-sized buckets) 20–24 24–29 #DLSAIS11 16 

17 .Running example: gender prediction Real social network edges. No features. Real labels: gender female male #DLSAIS11 17 

18 .Feature Visualization #DLSAIS11 18 

19 .Feature visualization What fictional inputs exemplify a class the most? “Feature Visualization” Chris Olah, et al., Distill #DLSAIS11 19 

20 .Creating examples random noise optimized image backprop on input to maximize class probability “Visualizing Higher-Layer Features of a Deep Network” Dumitru Erhan, Yoshua Bengio, Aaron Courville, Pascal Vincent #DLSAIS11 20 

21 .Creating graph examples Initial state: complete graph with 10 vertices features randomized, 0–1 Backprop: features adjacency matrix #DLSAIS11 21 

22 .Feature visualization: Friends of Friends #DLSAIS11 22 

23 .Feature visualization: Friends of Friends #DLSAIS11 23 

24 .Feature visualization: Three Friends #DLSAIS11 24 

25 .Feature visualization: age prediction 24–29 99.2% confidence #DLSAIS11 25 

26 .Feature visualization: age prediction 29–69 99.9998% confidence #DLSAIS11 26 

27 .Feature visualization: age prediction 99.99% 24–29 confidence 29–69 10–20 #DLSAIS11 27 

28 .Feature visualization: age prediction 99.99% 24–29 confidence 10–20 #DLSAIS11 28 

29 .Feature visualization: age prediction 99.99% 24–29 confidence 10–20 #DLSAIS11 29