使用说明
1. codematcher_analysis.py 用于解析原始数据集中方tokens的频率 github竞赛的数据集我仿照写了github_analysis 用这个就行了
- stat_method(), get statistics of method name in codebase.
- stat_parsed(), get statistics of method body in codebase.
- analyze_method(), get vocabulary of method name according to the output of stat_method().
- analyze_parsed(), get vocabulary of method body according to the output of stat_parsed().
5. Preprocess queries and parsed methods by codematcher_parse.py
- query_parse(), preprocess queries and get metadata for each token in queries.
- query_parse_tree(), generate query keywords with importance order.
6. Index codebase by codematcher_elasticsearch.py es 我已经附在工程目录里了，你只要解压然后把 根目录下的bin目录加入环境变量然后启动
- format_data(), save reprocessed method components to Json data structure.
- create_index(), create codebase index for elasticsearch. 为了简化直接用 create_simple_index()
- fill_data(), fill the formatted data to the elasticsearch. 简化直接用 fill_simple_data()
- fuzzy_search(), perform fuzzy search on the indexed code with parsed queries.
7. Rerank search results by codematcher_rerank.py
- reranking(), reorder the search results returned by the fuzzy_search() and generate the final results in 'search.txt'
- '_search_codematcher_parsed_lzw.txt' in Baidu Pan link shows the final result.