2bc21c6f18
Use oban for search indexing
2022-10-10 20:19:09 +03:00
6f2f457751
Add a search backend behaviour
2022-10-10 20:19:09 +03:00
571533ae26
Don't support meilisearch < 0.24.0, since it breaks things
2022-10-10 20:19:09 +03:00
3179ed0921
Make chunk size configurable
2022-10-10 20:19:09 +03:00
a12f63bc81
Implement suggestions from the Meilisearch MR
...
- Index unlisted posts
- Move version check outside of the streaming and only do it once
- Use a PUT request instead of checking manually if there is need to insert
- Add error handling, sort of
2022-10-10 20:19:09 +03:00
a6946048fb
Rename Activity.Search to Search.DatabaseSearch
2022-10-10 20:19:09 +03:00
0fae71f88d
Rename search.ex to database_search.ex and add search/2
2022-10-10 20:19:09 +03:00
39e596a5b5
Style fixes
2022-10-10 20:19:09 +03:00
7009ef5672
Move the search.ex file so credo doesn't complain
2022-10-10 20:19:09 +03:00
9c1a930707
Support reindexing meilisearch >=0.24.0
...
It has has a different error code key
2022-10-10 20:19:09 +03:00
e928e307f3
Add a reindex option
...
Signed-off-by: Ekaterina Vaartis <vaartis@kotobank.ch>
2022-10-10 20:19:09 +03:00
4445421297
Only add local posts to index in activity_pub
...
Remote ones are already added in another place
2022-10-10 20:19:09 +03:00
0b4fd0d342
Set content-type to application/json
2022-10-10 20:19:09 +03:00
e4b7a3f51f
Modify some meilisearch variables
2022-10-10 20:19:09 +03:00
cf558208c2
Use proper deleted object for removing from index
2022-10-10 20:19:09 +03:00
95cb2bb694
Don't try removing from index again in common_api
...
It's already removed in the side effects of the pipeline
2022-10-10 20:19:09 +03:00
6beef2d117
Move add_to_index / remove_from_index to Pleroma.Actitivy.Search
2022-10-10 20:19:09 +03:00
40280cc273
Reorder ranking rules for (maybe) better results
2022-10-10 20:19:09 +03:00
d9ef7e0758
Fix activity being passed to objec_to_search_data
2022-10-10 20:19:09 +03:00
09a1ae1b6e
Add the meilisearch.stats command
2022-10-10 20:19:09 +03:00
a67f9da5cc
Add a message with a count of posts to index
2022-10-10 20:19:09 +03:00
2c7d973af7
Implement meilisearch auth
2022-10-10 20:19:09 +03:00
410c8cb765
Make indexing logs rewrite themselves
2022-10-10 20:19:09 +03:00
35e9192ced
Rework task indexing to share code with the main module
...
The code in the main module now scrubs new posts too
2022-10-10 20:19:09 +03:00
3dedadf192
Adjust content indexing to skip more unneeded stuff
2022-10-10 20:19:09 +03:00
9f16ca80e0
Mark only content as searchable for meilisearch
2022-10-10 20:19:09 +03:00
2b2e409ad7
Also index incoming federated posts
2022-10-10 20:19:09 +03:00
e35d87ea54
Make the chunk size smaller
2022-10-10 20:19:09 +03:00
00c48a33ac
Use content instead of source and scrub it
2022-10-10 20:19:08 +03:00
9beaebd97e
Tweak search ordering to hopefully return newer results
2022-10-10 20:19:08 +03:00
38996f551a
Make meilisearch sort on publish date converted to unix time
2022-10-10 20:19:08 +03:00
ea6a6a1287
Make the indexing batch differently and more, show number indexed
2022-10-10 20:19:08 +03:00
365024abec
Ensure only indexing public posts and implement clearing and delete
2022-10-10 20:19:08 +03:00
0318e9a599
Add logging to milisiearch index and make it use desc(id)
2022-10-10 20:19:08 +03:00
e154ebbf79
Initial meilisearch implementation, doesn't delete posts yet
2022-10-10 20:19:08 +03:00
dd82fd234f
Merge branch 'release/2.4.4' into mergeback/2.4.4
2022-10-08 22:15:09 -04:00
3f1c31b7cd
Merge branch 'fix/exclude-deactivated-in-search' into 'develop'
...
User: search: exclude inactive users from user search
See merge request pleroma/pleroma!3755
2022-09-27 23:58:45 +00:00
5d7d623390
Merge branch 'bugfix/elixir-1.14' into 'develop'
...
Bugfix: Elixir 1.14
See merge request pleroma/pleroma!3740
2022-09-27 21:46:03 +00:00
1a7107f4a5
Merge branch 'remove_from_followers' into 'develop'
...
MastoAPI: POST /api/v1/accounts/:id/remove_from_followers
See merge request pleroma/pleroma!3647
2022-09-16 23:24:13 +00:00
7f63b4c315
User: search: exclude deactivated users from user search
...
This way we don't pollute search results with deactivated and deleted users
2022-09-16 00:49:16 +03:00
ea60c4e709
Fix wrong relationship direction
2022-09-14 20:24:04 -04:00
0b19625bfb
ObjectView: do not fetch an object for its ID
...
Non-Create/Listen activities had their associated object field
normalized and fetched, but only to use their `id` field, which is both
slow and redundant. This also failed on Undo activities, which delete
the associated object/activity in database.
Undo activities will now render properly and database loads should
improve ever so slightly.
2022-09-11 04:54:04 +02:00
b8d6cb5845
Merge branch 'from/upstream-develop/tusooa/2892-backup-scope' into 'develop'
...
Make backups require its own scope
Closes #2892
See merge request pleroma/pleroma!3721
2022-09-05 15:42:02 +00:00
346c130ddc
Merge branch 'fix/user-private-key-generation' into 'develop'
...
User: generate private keys on user creation
See merge request pleroma/pleroma!3737
2022-09-05 15:38:15 +00:00
f7c2073103
Merge branch 'bump/min-elixir-1.10' into 'develop'
...
Bump minimum Elixir version to 1.10
See merge request pleroma/pleroma!3741
2022-09-05 15:19:34 +00:00
9874b4c985
Merge branch 'develop' into 'from/upstream-develop/tusooa/2892-backup-scope'
...
# Conflicts:
# CHANGELOG.md
2022-09-05 15:00:19 +00:00
cd237d22f1
User: generate private keys on user creation
...
This fixes a race condition bug where keys could be regenerated
post-federation, causing activities and HTTP signatures from an user to
be dropped due to key differences.
2022-09-05 03:51:17 +02:00
f8afba95b2
Merge branch 'fix/gts-federation' into 'develop'
...
GoToSocial federation fixes
See merge request pleroma/pleroma!3725
2022-09-05 01:10:34 +00:00
20347898e2
Merge branch 'fix/federation-context-issues' into 'develop'
...
Fix reply context fixing (Pleroma replies to Misskey threads) and removal of context objects
See merge request pleroma/pleroma!3717
2022-09-04 18:43:36 +00:00
c63cf954de
Merge branch 'from/upstream-develop/tusooa/streaming-fix' into 'develop'
...
Streaming fix
Closes #2796
See merge request pleroma/pleroma!3738
2022-09-03 18:24:28 +00:00
Ekaterina Vaartis