WS-DREAM

Towards Open Datasets and Source Code
for Web Service Research


The Chinese University of Hong Kong

WS-DREAM is a Distributed REliability Assessment Mechanism for Web services. WS-DREAM contains 3 main components:

  1. Web services QoS prediction component, which allows users to carry out reliability and quality assessment of Web services in a collaborative way.
  2. Web services log management component, which provides an end-to-end framework for the reliability enhancement of services systems via logs.
  3. Web services review mining component, which analyzes user reviews automatically by natural language processing techniques.

This website is to disseminate our research results as well as release open datasets and source code for Web service research. With both datasets and source code publicly released, our WS-DREAM repository would allow ease of reproducing the existing approaches and flexibility of extending new ones.

+ Our publications about WS-DREAM have been cited 2000+ times in total.

+ Our datasets have been downloaded by 370+ research organizations globally, and have been used in 200+ papers.

+ Our prototypes have been used by industrial groups in Microsoft, Tencent, and Huawei.

Dataset

Our WS-DREAM repository maintains 3 sets of data: (1) QoS (Quality-of-Service) datasets; (2) log datasets; and (3) review datasets. The datasets are publicly released to hopefully facilitate valuable research in service computing. Please feel free to contact us if you have any comments or questions. We would love to hear from researchers on ideas to improve the WS-DREAM datasets.

QoS Prediction

We have implemented 30+ existing QoS prediction approaches for Web service recommendation, and released the source code in our GitHub repository. Especially, for future research on QoS prediction of Web services, you do not need to write your own program from scratch. The WS-DREAM framework can be easily extended to new implementations. Please feel free to contact us if you have any comments or questions regarding the code. We also appreciate any contributions from you.

Log Management

We have implemented (1) log advisor, (2) log parsers, and (3) anomaly detectors, and released their source code in our GitHub repository. For log advisor, we implement the "learning to log" framework that can determine optimal logging points. Considering log parser, 7 log parsers have been released, including 5 offline log parsers and 2 online log parsers. For anomaly detector, we implement 6 log-based anomaly detection methods, including 3 unsupervised detectors and 3 supervised detectors. Please feel free to contact us if you have any comments or questions regarding the code. We also appreciate any contributions from you.

Review Mining

We have implemented (1) IDEA, (2) CrossMiner, and (3) PAID, and released their source code in our GitHub repository. In particular, IDEA aims to identify emerging issues for mobile services effectively based on only review analysis. CrossMiner analyzes essential mobile services issues on different platforms. PAID is a framework that prioritizes mobile services issues for developers. Please feel free to contact us if you have any comments or questions regarding the code. We also appreciate any contributions from you.

Bibliography

Five representative publications that use or cite WS-DREAM:

Publication

Ten representative publications about WS-DREAM: [Full list]

  1. Shilin He, Qingwei Lin, Jian-Guang Lou, Hongyu Zhang, Michael R.Lyu, Dongmei Zhang, "Identifying Impactful Service System Problems via Log Analysis," in Proc. of the 26th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE), 2018.

  2. Cuiyun Gao, Jichuan Zeng, Michael R. Lyu, Irwin King, "Online App Review Analysis for Identifying Emerging Issues," in Proc. of the 40th International Conference on Software Engineering (ICSE), 2018.

  3. Pinjia He, Jieming Zhu, Shilin He, Jian Li, Michael R. Lyu, "Towards Automated Log Parsing for Large-Scale Log Data Analysis," IEEE Transactions on Dependable and Secure Computing (TDSC), 2017.

  4. Jieming Zhu, Pinjia He, Zibin Zheng, Michael R. Lyu, "Online QoS Prediction for Runtime Service Adaptation via Adaptive Matrix Factorization," IEEE Transactions on Parallel and Distributed Systems (TPDS), 2017.

  5. Hongbing Wang, Lei Wang, Qi Yu, Zibin Zheng, Michael R. Lyu, Athman Bouguettaya, "Online Reliability Prediction via Motifs-based Dynamic Bayesian Networks for Service-Oriented Systems," IEEE Transactions on Software Engineering (TSE), 2017.

  6. Jieming Zhu, Pinjia He, Qiang Fu, Hongyu Zhang, Michael R. Lyu, Dongmei Zhang "Learning to Log: Helping Developers Make Informed Logging Decisions," in Proc. of the 37th International Conference on Software Engineering (ICSE), 2015.

  7. Zibin Zheng, Hao Ma, Michael R. Lyu, Irwin King, "QoS-Aware Web Service Recommendation by Collaborative Filtering," IEEE Transactions on Services Computing (TSC), 2013.

  8. Zibin Zheng, Michael R. Lyu, "Collaborative Reliability Prediction of Service-Oriented Systems," in Proc. of ACM/IEEE International Conference on Software Engineering (ICSE), 2010. [ACM SIGSOFT Distinguished Paper Award]

  9. Zibin Zheng, Yilei Zhang, Michael R. Lyu, "Distributed QoS Evaluation for Real-World Web Services," in Proc. of IEEE International Conference on Web Services (ICWS), 2010. [Best Student Paper Award]

  10. Zibin Zheng, Michael R. Lyu, "WS-DREAM: A distributed Reliability Assessment Mechanism for Web Services," in Proc. of IEEE/IFIP International Conference on Dependable Systems and Networks (DSN), 2008.

Team

Project Leaders:

Michael R. Lyu

Professor, CUHK
ACM Fellow, IEEE Fellow, AAAS Fellow

Zibin Zheng

Associate Professor, Sun Yat-sen University
Postdoc & Ph.D., CUHK, 2007-2014

Jieming Zhu

Postdoc & Ph.D., CUHK
2011-2016

Pinjia He

Postdoc & Ph.D., CUHK
2013-2018

Project Members:

Cuiyun Gao

Ph.D., CUHK

Shilin He

Ph.D., CUHK

Zhuangbin Chen

Research Assistant
CUHK

Jian Li

Ph.D., CUHK

Yu Kang

Ph.D., CUHK, 2016

Yilei Zhang

Ph.D., CUHK, 2013

Jianlong Xu

Postdoc, CUHK
2013-2015

Visiting Researchers:

Qi Xie

Southwest University for Nationalities
Oct. 2015-Sep. 2016

Yang Li

Sun Yat-sen University
July.-Aug. 2015

Guanhong Tao

Sun Yat-sen University
July.-Aug. 2015

Tao Lei

Beijing University of Posts and Telecommunications
July.-Aug. 2015

Yao Wan

Zhejiang University
Dec. 2014

Haocao Ying

Zhejiang University
Dec. 2014

Buqing Cao

Hunan University of Science and Tecnology
Mar.-Sep. 2014

Chen Wu

Zhejiang University
Jul.-Aug. 2014

Yuwen Xiong

Zhejiang University
Jul.-Aug. 2014

Yifei Lu

Zhejiang University
Jul.-Aug. 2014

Liang Chen

Zhejiang University
Mar.-Sep. 2012

Weiwei Qiu

Zhejiang University
Mar.-Sep. 2012