Status: Past project

Project Description:
Research in search techniques was a critical component of the first generation of the Web, and has gone from academe to mainstream. A second generation Semantic Web will be built by adding semantic annotations that software can understand and from which humans can benefit. Modeling, discovering and reasoning about complex relationships on the Semantic Web will enable this vision and transform the hunt for documents into a more automated analysis enabled by semantic technology. The beginnings of this shift from search to analysis can be observed in research and industry as users look beyond finding relevant documents based on keywords to finding actionable information leading to decision making and insights. Large scale semantic annotation of data (domain-independent and domain-specific) is now possible because of an accumulation of advances in entity identification, automatic classification, taxonomy and ontology development, and metadata extraction. The next frontier, which fundamentally changes the way we acquire and use knowledge, is to automatically identify complex relationships between entities in this semantically annotated data. Instead of a search engine that returns documents containing terms of interest, we envision a system that returns actionable information (with the associated sources and supporting evidence) to a user or application. The user interacts with information universe through a hypothesis driven approach that combines search and inferencing, enabling more complex analysis and deeper insight. The examples in our narrative show that such a capability also greatly enhances the capacity of intelligence analysts to obtain (in time) information leading to a more secure homeland and world.

Our research will focus on the design, prototyping and evaluation of a system, called SemDIS (Semantic Discovery) that supports indexing and querying of complex semantic relationships and is driven by notions of information trust and provenance and models of hypotheses and arguments under investigation.

From scientific perspective, we face the challenges of formally defining and representing meaningful and interesting relationships (which we call semantic associations), and defining the notion of quality of results similar to the familiar metrics of precision, recall and document ranking. Another challenge is the (semi) automatic construction of argument structures built on these relationships to validate or deny a given hypothesis. Additional scientific and engineering challenges include those related to the scale of storing and complex query processing of large metadata sets, with corresponding more complex data structures to represent entities and relationships, the need to utilize context to select relevant subsets of metadata to process, and new techniques that use information provenance and trust to improve ranking of relationships. These challenges call for a fresh look at indexing, query processing, ranking, as well as tractable and scalable graph algorithms that exploit heuristics. Our work proposes to address these challenges building on our preliminary results in semantic metadata extraction, practical domain-specific ontology creations, defining semantic associations, main-memory query processing, using distributed trust to enforce security policies, and knowledge representation and reasoning on the semantic web. Scientific results from SemDIS will involve detailed scenarios and an evaluation testbed, and will be measured in terms of novel techniques as well as performance metrics and measures of quality, scalability and performance for computing complex semantic relationships. Corresponding to the breadth and depth of the topics involved in the challenge undertaken, ours is a collaborative proposal involving researchers at UGA and UMBC, covering the areas of information modeling and knowledge representation, storage and database management, information retrieval and artificial intelligence.

Our effort will have broader impacts beyond the education and training of graduate students, and the publication of research findings. Results from our research will be integrated with courses we teach, both existing and new. We will use institutional mechanisms in place to seek participation of students from underrepresented groups. Datasets used for testbed evaluations and some of the targeted tools will be made public or open source, and new measures for relevance and ranking of semantic associations will provide input to future work on comparing various approaches and techniques. Our work will also gain from several academic-industry collaborations of the investigators. We will have the opportunity to leverage commercial infrastructure and raw metadata provided by Semagix and IBM and, when appropriate, technology licensing will be encouraged. The researchers will collaborate with industry, and the students will be encouraged to intern at collaborating industrial labs. Within a broader social context, emerging knowledge-centric technologies raise legitimate privacy and civil liberties concerns. Building upon past policy making experience, we will comment on potential implications of our scientific progress. This research is supported in part by an NSF award ITR 0325172, and is a collaborative effort with colleagues at U. Georgia and Wright State University . Some demos associated with our efforts to find trust using DBLP and FOAF data can be found at the project's web page. We've also developed related software systems, supported by this and other awards, such as a semantic web search engine Swoogle, Community/sentiment/trust detection systems such as Feeds that matter and PolVox, amongst others.

Start Date: October 2003

End Date: October 2008

Principal Investigator:
Anupam Joshi

Faculty:
Yelena Yesha

Students:
Li Ding
Akshay Java
Anubhav Kale
Pranam Kolari
Onkar Walavalkar

Tags: semantic web, blogosphere, blog, splog, trust, foaf, information integration

There are 37 associated publications:  Hide the list...

33 Refereed Publications

2008

1. Akshay Java et al., "Approximating the Community Structure of the Long Tail", InProceedings, Proceedings of the Second International Conference on Weblogs and Social Media (ICWSM 2008), March 2008, 1443 downloads.

2. Amit Karandikar et al., "Second Space: A Generative Model For The Blogosphere", InProceedings, Proceedings of the International Conference on Weblogs and Social Media (ICWSM 2008), March 2008, 1200 downloads.

3. Boanerges Aleman-Meza et al., "Scalable semantic analytics on social networks for addressing the problem of conflict of interest detection", Article, ACM Transactions on the Web, February 2008, 699 downloads.

2007

4. Pranam Kolari, "Detecting Spam Blogs: An Adaptive Online Approach", PhdThesis, Ph.D. Dissertation, December 2007, 1708 downloads.

5. Akshay Java et al., "Using a Natural Language Understanding System to Generate Semantic Web Content", Article, International Journal on Semantic Web and Information Systems, November 2007, 1035 downloads.

6. Anupam Joshi et al., "Web 2.0 Mining: Analyzing Social Media", InProceedings, Proceedings of the NSF Symposium on Next Generation of Data Mining and Cyber-Enabled Discovery for Innovation, October 2007, 1850 downloads.

7. Onkar Walavalkar, "Streaming Knowledge Bases", MastersThesis, University of Maryland, Baltimore County, August 2007.

8. Amit Karandikar, "Generative Model To Construct Blog and Post Networks In Blogosphere", MastersThesis, University of Maryland at Baltimore County, May 2007, 2303 downloads.

9. Pranam Kolari et al., "Spam in Blogs and Social Media, Tutorial ", InProceedings, ICWSM 2007, March 2007, 1136 downloads.

10. Akshay Java et al., "Feeds That Matter: A Study of Bloglines Subscriptions", InProceedings, Proceedings of the International Conference on Weblogs and Social Media (ICWSM 2007), March 2007, 2671 downloads.

11. Akshay Java et al., "BlogVox: Separating Blog Wheat from Blog Chaff", InProceedings, Proceedings of the Workshop on Analytics for Noisy Unstructured Text Data, 20th International Joint Conference on Artificial Intelligence (IJCAI-2007), January 2007, 1125 downloads.

2006

12. Pranam Kolari et al., "Blog Track Open Task: Spam Blog Classification", InCollection, TREC 2006 Blog Track Notebook, November 2006, 3198 downloads.

13. Pranam Kolari et al., "Detecting Spam Blogs: A Machine Learning Approach", InProceedings, Proceedings of the 21st National Conference on Artificial Intelligence (AAAI 2006), July 2006, 4466 downloads.

14. Pranam Kolari et al., "Characterizing the Splogosphere", InProceedings, Proceedings of the 3rd Annual Workshop on Weblogging Ecosystem: Aggregation, Analysis and Dynamics, 15th World Wid Web Conference, May 2006, 3222 downloads.

15. Boanerges Aleman-Meza et al., "Semantic Analytics on Social Networks: Experiences in Addressing the Problem of Conflict of Interest Detection", InProceedings, Proceedings of the 15th International World Wide Web Conference,, May 2006, 1777 downloads.

16. Tim Finin et al., "Search Engines for Semantic Web Knowledge", InProceedings, Proceedings of XTech 2006: Building Web 2.0, May 2006, 9151 downloads.

17. Li Ding, "Enhancing Semantic Web Data Access", PhdThesis, University of Maryland, Baltimore County, April 2006, 1538 downloads.

18. Pranam Kolari et al., "SVMs for the Blogosphere: Blog Identification and Splog Detection", InProceedings, AAAI Spring Symposium on Computational Approaches to Analysing Weblogs, March 2006, 6033 downloads.

19. Pranam Kolari et al., "Memeta: A Framework for Multi-Relational Analytics on the Blogosphere", InProceedings, AAAI 2006 Student Abstract Program, February 2006, 1873 downloads.

20. Akshay Java et al., "SemNews: A Semantic News Framework", InProceedings, Proceedings of the Twenty-First National Conference on Artificial Intelligence (AAAI-06), February 2006, 2038 downloads.

21. Akshay Java et al., "Text understanding agents and the Semantic Web", InProceedings, Proceedings of the 39th Hawaii International Conference on System Sciences, January 2006, 3003 downloads.

2005

22. Tim Finin et al., "Social Networking on the Semantic Web", Article, The Learning Organization, December 2005, 3948 downloads.

23. Li Ding et al., "Finding and Ranking Knowledge on the Semantic Web", InProceedings, Proceedings of the 4th International Semantic Web Conference, November 2005, 5610 downloads.

24. Li Ding et al., "Tracking RDF Graph Provenance using RDF Molecules", InProceedings, Proceedings of the 4th International Semantic Web Conference, November 2005, 2539 downloads.

25. Li Ding et al., "Search on the Semantic Web", Article, IEEE Computer, October 2005, 1685 downloads.

26. Tim Finin et al., "Swoogle: Searching for knowledge on the Semantic Web", InProceedings, AAAI 05 (intelligent systems demo), July 2005, 2897 downloads.

27. Pranam Kolari et al., "Enhancing Web Privacy Protection through Declarative Policies", InProceedings, Proceedings of the IEEE Workshop on Policy for Distributed Systems and Networks(POLICY 2005), June 2005, 3694 downloads.

28. Li Ding et al., "On Homeland Security and the Semantic Web: A Provenance and Trust Aware Inference Framework", InProceedings, Proceedings of the AAAI SPring Symposium on AI Technologies for Homeland Security, March 2005, 1879 downloads.

29. Li Ding et al., "How the Semantic Web is Being Used:An Analysis of FOAF Documents", InProceedings, Proceedings of the 38th International Conference on System Sciences, January 2005, 5628 downloads.

30. Li Ding et al., "Analyzing Social Networks on the Semantic Web", Article, IEEE Intelligent Systems, January 2005, 4244 downloads.

2004

31. Li Ding et al., "Swoogle: A Search and Metadata Engine for the Semantic Web", InProceedings, Proceedings of the Thirteenth ACM Conference on Information and Knowledge Management , November 2004, 14770 downloads.

32. Li Ding et al., "Modeling and Evaluating Trust Network Inference", InProceedings, Seventh International Workshop on Trust in Agent Societies at AAMAS 2004, July 2004, 2379 downloads.

2003

33. Li Ding et al., "Trust Based Knowledge Outsourcing for Semantic Web Agents", InProceedings, Proceedings of the 2003 IEEE/WIC International Conference on Web Intelligence, October 2003, 1362 downloads.

4 Non-Refereed Publications

2007

1. Pranam Kolari et al., "Spam Blogs: Ping Servers and Adversaries", TechReport, , March 2007.

2006

2. Akshay Java et al., "Using a Natural Language Understanding System to Generate Semantic Web Content", TechReport, , October 2006, 971 downloads.

2005

3. Li Ding et al., "Tracking RDF Graph Provenance using RDF Molecules", TechReport, TR-CS-05-06, April 2005, 2473 downloads.

2004

4. Li Ding et al., "Weaving the Web of Belief into the Semantic Web", Misc, submitted to WWW2004, May 2004, 4158 downloads.

There is 1 associated resource:  Hide the list...

1. SEMDIS poster (June 2004), Poster.

Research Areas:
 Security, Trust and Privacy
 Semantic Web

Assertions:

1. (Project) Semantic Discovery: Discovering Complex Relationships in Semantic Web has related publication (Publication) Social Networking on the Semantic Web