Jiejun Xu

About Me

I am a Senior Scientist in the Intelligent Systems Lab at HRL Laboratories in Malibu, California. I am currently leading the Knowledge Navigation Center (KNC) and overseeing its research activities. While at HRL, I have served as the Principal Investigator and Program Manager across a range of projects supported by the Boeing Company, General Motors, and various government agencies. Before joining HRL, I received my Ph.D. from the Computer Science Department at the University of California, Santa Barbara. I was affiliated with the Vision Research Lab, the Center for Bio-Image Informatics, and the Information Network Academic Research Center. My current research interests are Graph Machine Learning, Natural Language Processing, and Computer Vision, with an emphasis on the autonomy and cybersecurity applications.

Project Highlights

• PI: DARPA Modeling Adversarial Activity (CRAD)
• PI/PM: Network of Networks Summarization, Predictive and Prescriptive Networks, Open Source Intelligence, Network-based Data Integration, Retail Anomaly Detection, Knowledge-infused Autonomy, Enterprise Knowledge Management (IRADs)
• Task Lead: DARPA ASED, IARPA OSI, DARPA Neovision2, ONR NEMESIS, NGA BIG, Personal Autonomous Vehicle (CRAD/IRADs)
• Participant: DARPA URGENT, IARPA HFC, NGA GEOCOG, Swarm Vision, Factory Visual Perception, Brain on Board (CRAD/IRADs)

Publications

• Dana Warmsley, Jiejun Xu, Samuel Johnson. Assessing the Sociocultural Alignment of Large Language Models: An Empirical Study of Chinese-Speaking Populations. The 17th International Conference on Social Computing, Behavioral-Cultural Modeling & Prediction and Behavior Representation in Modeling and Simulation (SBP-BRiMS), 2024.
• Lecheng Zheng, Dawei Zhou, Hanghang Tong, Jiejun Xu, Yada Zhu, Jingrui He. FAIRGEN: Towards Fair Graph Generation. The 40th IEEE International Conference on Data Engineering (ICDE), 2024.
• Sasha Strelnikoff, Jiejun Xu, Alireza Esna Ashari. Towards the Semantic Interpretation of Arbitrary Traffic Signs: Semantic Parsing for Action-oriented Signs. International Conference on Machine Learning and Applications (ICMLA), 2023.
• Irsyad Adam, Alex Waagen, Dana Warmsley, Jiejun Xu. Learning Explainable Multi-view Representations for Malware Authorship Attribution. International Conference on Big Data (IEEE BigData), 2023.
• Rodolfo Valiente, Darren Chan, Alan Perry, Joshua Lampkins, Sasha Strelnikoff, Jiejun Xu, Alireza Esna Ashari. Robust Perception and Visual Understanding of Traffic Signs in the Wild. IEEE Open Journal of Intelligent Transportation System (OJ-ITS), Volume 4, 2023.
• Dana Warmsley, Alex Waagen, Jiejun Xu, Zhining Liu, Hanghang Tong. A Survey of Explainable Graph Neural Networks for Cyber Malware Analysis. In International Conference on Big Data (IEEE BigData), 2022.
• Joshua Lampkins, Darren Chan, Alan Perry, Sasha Strelnikoff, Jiejun Xu, Alireza Esna Ashari. Multimodal Road Sign Interpretation for Autonomous Vehicles. In International Conference on Big Data (IEEE BigData), 2022.
• Lihui Liu, Houxiang Ji, Jiejun Xu, Hanghang Tong. Comparative Reasoning for Knowledge Graph Fact Checking. In International Conference on Big Data (IEEE BigData), 2022.
• Lihui Liu, Boxin Du, Jiejun Xu, Yinglong Xia, Hanghang Tong. Joint Knowledge Graph Completion and Question Answering. In SIGKDD Conference on Knolwedge Discovery and Data Mining (ACM KDD), 2022.
• Kang-Yu Ni, Jiejun Xu, Shane Roach, Tsai-Ching Lu, Alexei Kopylov. Characterizing Disease Spreading via Visibility Graph Embedding. In International Conference on Big Data (IEEE BigData), 2021
• Zhe Xu, Si Zhang, Yinglong Xia, Liang Xiong, Jiejun Xu, Hanghang Tong. DESTINE: Dense Subgraph Detection on Multi-Layered Networks. In ACM International Conference on Information and Knowledge Management (ACM CIKM), 2021.
• Tyler Derr, Hamid Karimi, Xiaorui Liu, Jiejun Xu, Jiliang Tang. Deep Adversarial Network Alignment. In ACM International Conference on Information and Knowledge Management (ACM CIKM), 2021.
• Lihui Liu, Boxin Du, Yi Ren Fung, Heng Ji, Jiejun Xu, Hanghang Tong. KompaRe: A Knowledge Graph Comparative Reasoning System. In SIGKDD Conference on Knolwedge Discovery and Data Mining (ACM KDD), 2021.
• Alexei Kopylov, Jiejun Xu, Connie Ni, Shane Roach, Tsai-Ching Lu. Semantic Guided Filtering Strategy for Best-effort Subgraph Matching in Knowledge Graphs. In International Conference on Big Data (IEEE BigData), Workshop on Graph Techniques for Adversarial Activity Analytics, 2020.
• Shane Roach, Connie Ni, Alexei Kopylov, Tsai-Ching Lu, Jiejun Xu, Si Zhang, Boxin Du, Dawei Zhou, Jun Wu, Lihui Liu, Yuchen Yan, Jingrui He, and Hanghang Tong. CANON: Complex Analytics of Network of Networks. In International Conference on Big Data (IEEE BigData), 2020.
• Si Zhang, Hanghang Tong, Yinglong Xia, Liang Xiong, Jiejun Xu. NetTrans: Neural Cross-Network Transformation. In SIGKDD Conference on Knolwedge Discovery and Data Mining (ACM KDD), 2020.
• Si Zhang, Hanghang Tong, Jie Tang, Jiejun Xu, Wei Fan. Incomplete Network Alignment: Problem Definitions and Fast Solutions. In ACM Transactions on Knowledge Discovery from Data, Volume 14, 2020.
• Alexei Kopylov, Jiejun Xu. Filtering Strategies for Inexact Subgraph Matching on Noisy Multiplex Networks. In International Conference on Big Data (IEEE BigData), Workshop on Graph Techniques for Adversarial Activity Analytics, 2019.
• Lihui Liu, Boxin Du, Jiejun Xu, Hanghang Tong. G-Finder: Approximate Attribute Subgraph Matching. In International Conference on Big Data (IEEE BigData), 2019.
• Si Zhang, Hanghang Tong, Jiejun Xu, Yifan Hu, Ross Maciejewski. Origin: Non-Rigid Network Alignment. In International Conference on Big Data (IEEE BigData), 2019.
• Jiejun Xu, Kang-Yu Ni, Alexei Kopylov, Shane Roach, Tsai-Ching Lu. On Modeling Adversarial Activities in Large Multi-Source Networks. NetSci, 2019.
• Si Zhang, Hanghang Tong, Jiejun Xu, Ross Maciejewski. Graph convolutional networks: a comprehensive review. In Computational Social Networks, 2019.
• Jun Wu, Jingrui He, Jiejun Xu. DEMO-Net: Degree-specific Graph Neural Networks for Node and Graph Classification. In SIGKDD Conference on Knolwedge Discovery and Data Mining (ACM KDD), Alaska, USA, 2019.
• Dawei Zhou, Lecheng Zheng, Jiejun Xu, Jingrui He. Misc-GAN: A Multi-Scale Generative Model for Graphs. In Frontiers in Big Data, Vol 2, 2019.
• Santosh Pandey, Xiaoye Sherry Li, Aydin Buluç, Jiejun Xu, Hang Liu. H-INDEX: Hash-indexing for parallel triangle counting on GPUs. In IEEE High Performance Extreme Computing Conference (HPEC), 2019.
• Tyler Derr, Hamid Karimi, Xiaorui Liu, Jiejun Xu, Jiliang Tang. Deep Adversarial Network Alignment. In arXiv:1902.10307, 2019.
• Dana Warmsley, Jiejun Xu, Tsai-Ching Lu. From Gamergate to FIFA: Identifying Polarized Groups in Online Social Media. In International Conference on Big Data (IEEE BigData), Workshop on Graph Techniques for Adversarial Activity Analytics, Seattle, USA, 2018.
• Si Zhang, Hanghang Tong, Jiejun Xu, Ross Maciejewski. Graph Convolutional Networks: Algorithms, Applications and Open Challenges. In IEEE International Conference on Computational Data & Social Networks (CSoNet), 2018.
• Aruna Jammalamadaka, Jiejun Xu, and Tsai-Ching Lu. Behavioral Deviations in Social Media Caused by Emergency Events. In Social Computing, Behavioral-Cultural Modeling & Prediction and Behavior Representation in Modeling and Simulation (SBP-BRiMS), 2018.
• Joel Douglas, Ben Zimmerman, Alexei Kopylov, Jiejun Xu, Daniel Sussman, and Vince Lyzinski. Metrics for Evaluating Network Alignment. In ACM Conference on Web Search and Data Mining (WSDM), Workshop on Graph Techniques for Adversarial Activity Analytics (GTA³) , Los Angeles, USA, 2018.
• Daniel Xie, Jiejun Xu, Tsai-Ching Lu. What's trending tomorrow, today: Using early adopters to discover popular posts on Tumblr. In International Conference on Big Data (IEEE BigData), Boston, USA, 2017.
• Steven Munn, Kang-Yu Ni, Jiejun Xu. Learning Network Dynamics from Tumblr: A Search for Influential Users. In Social Computing, Behavioral-Cultural Modeling & Prediction and Behavior Representation in Modeling and Simulation (SBP-BRiMS), 2017.
• Krishna Bathina, Aruna Jammalamadaka, Jiejun Xu, Tsai-Ching Lu. An Agent-based Model of Posting Behavior During Times of Societal Unrest. In Social Computing, Behavioral-Cultural Modeling & Prediction and Behavior Representation in Modeling and Simulation (SBP-BRiMS), 2017.
• Si Zhang, Hanghang Tong, Jie Tang, Jiejun Xu, Wei Fan. iNEAT: Incomplete Network Alignment. In EEE International Conference on Data Mining (ICDM), New Orlean, USA, 2017
• Laura Cruz-Albrecht, Jiejun Xu, Kang-Yu Ni and Tsai-Ching Lu: Characterizing Regional and Behavioral Device Variations Across the Twitter Timeline: a Longitudinal Study. In ACM Web Science Conference (WebSci), Troy, USA, 2017
• Jiejun Xu, Daniel Xie, Tsai-Ching Lu, John Cafeo. EDSV: Emerging Defect Surveillance for Vehicles. In ACM Web Science Conference (WebSci), Troy, USA, 2017
• Deepak Khosla, Jiejun Xu, Kyungnam Kim, Yang Chen. Online Location Recognition for drift-free trajectory estimation and efficient autonomous navigation. In Proc. SPIE Unmanned Systems Technology XIX, 2017.
• Jiejun Xu, Samuel Johnson, Kang-Yu Ni. Cross-Modal Event Summarization: A Network of Networks Approach. In International Conference on Big Data (IEEE BigData), Washington D.C., USA, 2016. (also appears NetSci 2017 lightning talk)
• Daniel Xie, Jiejun Xu, Tsai-Ching Lu. Automated Classification of Extremist Twitter Accounts Using Content-Based and Network-Based Features. In IEEE BigData, workshop on Application of BigData for Computational Social Science, Washington D.C., USA, 2016.
• Jiejun Xu, Kyungnam Kim, Lei Zhang, Deepak Khosla. 3D Perception for Autonomous Robot Exploration. In 11th International Symposium on Visual Computing (ISVC), Las Vegas, USA, 2015.
• Kyungnam Kim, David J. Huber, Jiejun Xu, Deepak Khosla. Efficient Algorithms for Indoor MAV Flight using Vision and Sonar Sensors. In 11th International Symposium on Visual Computing (ISVC), Las Vegas, USA, 2015.
• Jiejun Xu, Tsai-Ching Lu. Toward Precise User-Topic Alignment in Online Social Media. In IEEE International Conference on Big Data (IEEE BigData), Santa Clara, California, 2015.
• Peter Li, Jiejun Xu, Tsai-Ching Lu. Leveraging Homophily to Infer Demographic Attributes. Workshop on Information in Networks, New York, USA, 2015.
• Jiejun Xu, Tsai-Ching Lu. Inferring User Interests with a Heterogeneous Bi-relational Graph Model, Conference on Complex Systems (CCS), Arizona, USA, 2015. (Extended abstract)
• Jiejun Xu, Tsai-Ching Lu. Seeing the Big Picture from Microblogs: Harnessing Social Signals for Visual Event Summarization. In ACM Conference on Intelligent User Interfaces (IUI), Atlanta, USA, 2015.
• Jiejun Xu, Tsai-Ching Lu. Inferring User Interests on Tumblr. In Social Computing, Behavioral Modeling and Prediction Conference (SBP), Washington DC, USA, 2015.
• Ryan Compton, Craig Lee, Jiejun Xu, Luis Artieda-Moncada, Tsai-Ching Lu, Lalindra De Silva, Michael Macy. Using Publicly Visible Social Media to Build Detailed Forecasts of Civil Unrest. In Springer Journal on Security Informatics, 2014.
• Jiejun Xu, Kyungnam Kim, Zhiqi Zhang, Hai-Wen Chen, Yuri Owechko. 2D/3D Sensor Exploitation and Fusion for Enhanced Object Detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Workshop on Multi-Sensor Fusion for Outdoor Dynamic Scene Understanding, Columbus, USA, 2014.
• Jiejun Xu, Ryan Compton, Tsai-Ching Lu, David Allen. Rolling through tumblr: Characterizing Behavioral Patterns of the Microblogging Platform. In ACM Web Science Conference (WebSci), Bloomington, USA, 2014.
• Jiejun Xu, Ryan Compton, Tsai-Ching Lu, David Allen. Quantifying Cross-platform Engagement through Large-scale User Alignment. In ACM Web Science Conference (WebSci), Bloomington, USA, 2014.
• Ryan Compton, Matthew Keegan, Jiejun Xu. Inferring the Geographic Focus of Online Documents from Social Media Sharing Patterns. In Computational Approaches to Social Modeling Workshop (ChASM), Bloomington, USA, 2014.
• Jiejun Xu, Tsai-Ching Lu, Ryan Compton, David Allen. Civil Unrest Prediction: A Tumblr-Based Exploration. In Social Computing, Behavioral Modeling and Prediction Conference (SBP), Washington DC, USA, 2014.
• Jiejun Xu, Vignesh Jagadeesh, B. S. Manjunath. Multi-Label Learning With Fused Multimodal Bi-Relational Graph. In IEEE Transactions on Multimedia (TMM), 2014.
• Santhoshkumar Sunderrajan, Jiejun Xu, B. S. Manjunath. Context-aware Graph Modeling for Object Search and Retrieval in a Wide Area Camera Network. In International Conference on Distributed Smart Camers (ICDSC), Palm Springs, USA, 2013.
• Jiejun Xu, Graph-based transductive learning for visual classification and retrieval, UCSB, 2013 (PhD Thesis).
• Jiejun Xu, Vignesh Jagadeesh, Zefeng Ni, Santhoshkumar Sunderrajan, B. S. Manjunath. Graph-Based Topic-Focused Retrieval in Distributed Camera Network. In IEEE Transactions on Multimedia (TMM), 2013.
• Zefeng Ni, Jiejun Xu, B.S. Manjunath. Object Browsing and Searching in a Camera Network using Graph Models. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Workshop on Camera Networks & Wide Area Scence Analysis, Providence, USA, 2012.
• Jiejun Xu, Ziyu Guan, Vishwakarma Singh, B.S. Manjunath. Unified Hypergraph for Image Ranking in a Multimodal Context. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Kyoto, Japan, 2012.
• Kyungnam Kim, Michael Cao, Shankar Rao, Jiejun Xu, Swarup Medasani, Yuri Owechko. Multi-Object Detection and Behavior Recognition from Motion 3D Data. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Workshop on Human Activity Understanding from 3D Data, Colorado Springs, USA, 2011.
• Jiejun Xu, Zefeng Ni, Carter De Leo, Thomas Kuo, and B.S. Manjunath. Spatial-Temporal Understanding of Urban Scenes through Large Camera Network. In ACM International Conference on Multimedia, Workshop on Multimodal Pervasive Video Analysis, Florence, Italy, 2010.
• Emily Moxley, Jim Kleban, Jiejun Xu, B.S. Manjunath. Not all tags are created equal: Learning flickr tag semantics for global annotation. In IEEE International Conference on Multimedia and Expo (ICME), New York, USA, 2009.
• Jim Kleban, Emily Moxley, Jiejun Xu, B.S. Manjunath. Global Annotation on Georeferenced Photographs. In ACM International Conference on Image and Video Retrieval (CIVR), Santorini, Greece, 2009.
• Xavier Anguera, Jiejun Xu, Nuria Oliver. Multimodal Photo Annotation and Retrieval on a Mobile Phone. In ACM Conference on Multimedia Information Retrieval (MIR), Vancouver, Canada, 2008.
• Elisa Drelie Gelasca, Swapna Joshi, Jim Kleban, Stephen Mangiat, B. S. Manjunath, Emily Moxley, Anindya Sarkar, Jiejun Xu. The Vision Research Lab of UCSB at TRECVID. TRECVID workshop, 2007.
• Elisa Drelie Gelasca, Joriz De Guzman, Steffen Gauglitz, Pratim Ghosh, JieJun Xu, Emily Moxley, Amir M. Rahimi, Zhiqiang Bi and B. S. Manjunath. CORTINA: Searching a 10 Million+ Images Database. VRL Technical Report, ECE, University of California, Santa Barbara, 2007.

Granted Patents

• Three-Dimensional Object Detection and Multi-Agent Behavior Recognition using 3D Motion Data. (US8948501B1)
• Sensor Fusion using Detector Confidence Boosting. (US9183459B1)
• Fast Open Doorway Detection for Autonomous Robot Exploration. (US9251417B1)
• System for filtering, segmenting and recognizing objects in unconstrained environments. (US9633483B1)
• Method for object localization and pose estimation for an object of interest. (US9875427B2)
• System and method for real world event summarization with microblog data. (US10055486B1)
• Generic frontal and side doorway detection with line tracking and vanishing point based verification. (US10068336B1)
• System and method for finding open space efficiently in three dimensions for mobile robot exploration. (US10134135B1)
• Tensor-based framework for analyzing high velocity large-scale network activities to infer latent mesostructures and important nodes. (US10218579B1)
• Social media mining system for early detection of civil unrest events. (US10255352B1)
• Accurate user alignment across online social media platforms. (US10305845B1)
• System and method for assessing spatiotemporal impact of emergency events based on social media posting behavior. (US 10326847)
• System and method for location recognition and learning utilizing convolutional neural networks for robotic exploration. (US10373335B1)
• System and method for drift-free global trajectory estimation of a mobile platform. (US10518879B1)
• Multiscale, hierarchical clustering on customer observables using persistent geometric features of co-occurrence simplicial complexes. (US10614103B2)
• A system for inferring network dynamics and sources within the network. (US10652104B1)
• Cross-modal event summarization system based on network of networks representations. (US10757061B1)
• Comprehensive causal impact estimation system with a selective synthetic control. (US10838377B1)
• A system and method for pairwise network alignment. (US10887182B1)
• Cross-Disciplinary Device Characterization System for Structured Analysis and Targeted Marketing. (US11074597B1)
• State Transition Network Analysis of Multiple One-Dimensional Time Series. (US11106989B1)
• Automated System to Identify Polarized Groups on Social Media. (US11126689B1)
• Hypergraph-based method for segmenting and clustering customer observables for vehicles. (US11244115B2)
• System and method for event prediction using online social media. (US11475334B1)
• Continuously habituating elicitation strategies for social-engineering-attacks. (US11494486B1)
• Computational framework for modeling adversarial activities (US11671436B1)
• Filtering strategies for subgraph matching on noisy multiplex networks (US11695788B1)

Work Experience

• Research Intern, Hughes Research Laboratories, 2009 ~ 2012
• Research Intern, Telefonica Research, Barcelona, Apr 2008 ~ Sept 2008
• Graduate Researcher, Vision Research Lab, UCSB, 2006 ~ 2012
• Research Developer, Center of Bio-Image Informatics, 2005 ~ 2007

Teaching Experience

• CS130a: Data Structure and Algorithm I (S06, F10, M11)
• CS24: Problem Solving II
• CS20: Programming Method (W08)
• CS10: Computer Programming (F07)
• CS5ja: Introduction to Computer Programming (W08,F08,S09)
• ENGR 3: Introduction to Programming for Engineers

Research Activities

• Organizer, 2018 ACM WSDM: Workshop on Graph Techniques for Adversarial Activity Analytics (GTA³)
• Organizer, 2018 ~ 2023 IEEE BigData: Workshop on Graph Techniques for Adversarial Activity Analytics (GTA³ 2.0, GTA³ 2019, GTA³ 2020, GTA³ 2021, GTA³ 2022, GTA³ 2023)
• Organizer, 2024 ACM CIKM: The 8th Workshop on Graph Techniques for Adversarial Activity Analytics (GTA³ 2024)
• Program Committee: KDD, AAAI, CIKM, BigData, DSAA, SBP, TMM, CVPR, ICCV, ICIP, etc.