USING FREQUENT PATTERN MINING ALGORITHMS IN TEXT ANALYSIS
Piotr Ożdżyński · Information System in Management · 2017
With the growing number of IT projects and their complexity their deeper analysis became necessary.For this purpose, the historical data on previously completed projects began to collect -it has enabled projects undergo a detailed analysis, which allowed the efficient implementation of projects and allowed in advance to detect the potential problems.Thus a new area of research, Mining Software Repository (MSR), was born.Research in the field of MSR brings very promising results.The increasing importance of research for gaining the tools to support the process of collecting and analyzing the data related to software development is observed.The data from version control systems, bug tracking systems and issue tracking systems is the most popular.This paper presents the existing MSR tools carries out its analysis and describes the weaknesses of each individual solutions.Keywords: software mining, software analytics, MSR tools and support analyzing the existing OSS projects from platforms such as Source-Forge, Google Code, GitHub, Mozilla and Apache [5, 10].Candoia is a platform to support development of MSR programs.It is for MSR tools as Android for mobile applications.Researcher can build MSR programs, without worrying about access to project data such as bugs or source code.He can use also Candoia application store which allow download programs created by other researchers and share with others their own applications.Candoia offers ready to use abstractions for popular MSR artifacts e.g.VCS or bug.Researcher can perform all tasks via web interface [11].Bitergia is open source software to analyze project data.The application through the web interface provides an overview about whole project ecosystem (e.g.code review and management, documentation processes).The biggest advantages of Bitergia are provided reports: KPIs, benchmarking between projects, quantitative studies, maturity level analysis, good\bad practices of cooperation during software development.Bitergia supports almost 30 types of project data [1].SmartShark is a general-purpose platform for supporting MSR research.It supports a variety of data.Architecture of SmartShark allows the researcher to reduce the tasks to two tasks: select a project from which the data will be analyzed, write analysis program.This allows the researcher to focus on the analysis.ETL process is responsible for preparing the data for the analysis.The result of its action is saved to MongoDB.Analysis program must base on Apache Spark.Programs are executed on the Hadoop cluster, where they can access the MongoDB.The researcher communicates with the platform via this web based interface [11].To summarize, the tools for collecting and analyzing project data are very complex.They allow researchers to extract the knowledge from project data and focus only on analyses of data, not on infrastructure problems.The summary of the advantages and disadvantages of this type of tools is as follows:a) advantages:• support various types of project data: BuCo Reporter supports SVN, Jira, Bugzilla; OSSMeter supports SVN, Git, Bugzilla, BitBucket, Jira, Redmine, SourceForge; Bitergia supports almost 30 types of project data; Candoia supports GitHub, Jira, Bugzilla, • open source license: BuCo Reporter, OSSMeter, Candoia, Bitergia,• ability to define the data format: yes for OSSMeter, BuCoReporter and no for Candoia, Bitergia, b) disadvantages:• metrics only offered by tool but the huge number of them: BuCo Reporter, OSSMeter, Candoia, Bitergia, • ability to use data from multiple projects: no for Candoia, BuCo Reporter and yes for OSSMeter, Bitergia.