mirror of
https://github.com/go-gitea/gitea.git
synced 2024-12-04 08:13:57 +08:00
f64fbd9b74
This PR improves the accuracy of Gitea's code search.
Currently, Gitea does not consider statements such as
`onsole.log("hello")` as hits when the user searches for `log`. The
culprit is how both ES and Bleve are tokenizing the file contents (in
both cases, `console.log` is a whole token).
In ES' case, we changed the tokenizer to
[simple_pattern_split](https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-simplepatternsplit-tokenizer.html#:~:text=The%20simple_pattern_split%20tokenizer%20uses%20a,the%20tokenization%20is%20generally%20faster.).
In such a case, tokens are words formed by digits and letters. In
Bleve's case, it employs a
[letter](https://blevesearch.com/docs/Tokenizers/) tokenizer.
Resolves #32220
---------
Signed-off-by: Bruno Sofiato <bruno.sofiato@gmail.com>
15 lines
852 B
Plaintext
15 lines
852 B
Plaintext
# pack-refs with: peeled fully-peeled sorted
|
|
90c1019714259b24fb81711d4416ac0f18667dfa refs/heads/DefaultBranch
|
|
985f0301dba5e7b34be866819cd15ad3d8f508ee refs/heads/branch2
|
|
65f1bf27bc3bf70f64657658635e66094edbcb4d refs/heads/develop
|
|
65f1bf27bc3bf70f64657658635e66094edbcb4d refs/heads/feature/1
|
|
78fb907e3a3309eae4fe8fef030874cebbf1cd5e refs/heads/home-md-img-check
|
|
9f894b61946fd2f7b8b9d8e370e4d62f915522f5 refs/heads/master
|
|
62fb502a7172d4453f0322a2cc85bddffa57f07a refs/heads/pr-to-update
|
|
4649299398e4d39a5c09eb4f534df6f1e1eb87cc refs/heads/sub-home-md-img-check
|
|
3fa2f829675543ecfc16b2891aebe8bf0608a8f4 refs/notes/commits
|
|
4a357436d925b5c974181ff12a994538ddc5a269 refs/pull/2/head
|
|
5f22f7d0d95d614d25a5b68592adb345a4b5c7fd refs/pull/3/head
|
|
62fb502a7172d4453f0322a2cc85bddffa57f07a refs/pull/5/head
|
|
65f1bf27bc3bf70f64657658635e66094edbcb4d refs/tags/v1.1
|