58a4f350a8
Refactor gun pooling and simplify adapter option insertion
...
This patch refactors gun pooling to use Elixir process registry and
simplifies adapter option insertion.
Having the pool use process registry instead of a GenServer has a number of advantages:
- Simpler code: the initial implementation adds about half the lines of code it deletes
- Concurrency: unlike a GenServer, ETS-based registry can handle multiple checkout/checkin
requests at the same time
- Precise and easy idle connection clousure: current proposal for closing idle connections in
the GenServer-based pool needs to filter through all connections once a minute and compare their
last active time with closing time. With Elixir process registry this can be done
by just using `Process.send_after`/`Process.cancel_timer` in the worker process.
- Lower memory footprint: In my tests `gun-memory-leak` branch uses about 290mb on peak load (250 connections)
and 235mb on idle (5-10 connections). Registry-based pool uses 210mb on idle and 240mb on peak load
2020-07-15 15:17:27 +03:00
439a1a0218
added wrapper Pleroma.HTTP for ExAws.S3
2020-06-25 07:12:29 +03:00
721fc7c554
added wrapper Pleroma.HTTP for Tzdata.HTTPClient
2020-06-24 09:12:32 +03:00
0cb7b0ea84
hackney adapter helper: support tlsv1.3 and remove custom opts
...
- partitial_chain is no longer exported, but it seems to be the default anyway.
- The bug that caused sni to not be sent automatically seems to be fixed -
https://github.com/benoitc/hackney/issues/612
2020-05-30 15:36:55 +03:00
98ed0d1c4b
more clean up
2020-03-13 09:37:57 +03:00
1306b92997
clean up
2020-03-12 18:29:07 +03:00
f39e1b9eff
add verify tls_opts only when we open connection
...
for other requests tesla will add tls_opts
2020-03-10 15:54:11 +03:00
78282dc983
little polishing
2020-03-06 21:24:19 +03:00
c93c3096d5
little refactor
2020-03-06 21:04:18 +03:00
f0753eed0f
removing try block in tesla request
...
added mocks for tests which fail with Tesla.Mock.Error
2020-03-05 17:31:06 +03:00
d6bebd4f9c
moving some logic to tesla adapter
...
- checking original inside gun adapter
- flushing streams on max_body error
2020-03-04 18:13:24 +03:00
d9c5ae7c09
Update Copyrights for gun related files
2020-03-03 17:16:24 -06:00
4427161ca3
Merge branch 'develop' into gun
2020-03-03 17:15:49 -06:00
05da5f5cca
Update Copyrights
2020-03-03 16:44:49 -06:00
f98ee730f0
adapter renaming to adapter_helper
2020-03-03 18:53:44 +03:00
8854770fc4
retry and retry_timeout settings default change
2020-03-03 18:01:35 +03:00
1ad34bfdba
no try block in checkout connection
2020-03-03 17:44:04 +03:00
24bf5c4e89
remove try block from pool request
2020-03-03 17:27:56 +03:00
aaa879ce75
proxy parsing errors
2020-03-03 17:27:22 +03:00
6ebf389d6e
poolboy timeout fix
2020-03-03 16:51:49 +03:00
e605e79df9
simplification of formatting host method
...
case for format_proxy method
2020-03-03 16:42:03 +03:00
ee8071f0d5
removing unused method
2020-03-03 15:12:09 +03:00
05429730e4
unnecessary with
2020-03-03 15:11:48 +03:00
a21a66972f
Apply suggestion to lib/pleroma/http/http.ex
2020-03-03 09:52:01 +00:00
614e3934f9
Apply suggestion to lib/pleroma/http/http.ex
2020-03-03 09:50:42 +00:00
d30ff35d94
Apply suggestion to lib/pleroma/http/request_builder.ex
2020-03-03 09:46:53 +00:00
a3ad028973
Apply suggestion to lib/pleroma/http/adapter.ex
2020-03-03 09:34:36 +00:00
8efae966b1
open conn in separate task
2020-02-24 19:56:27 +03:00
d44f9e3b6c
fix for timeout clause
2020-02-21 16:56:55 +03:00
f604f9e470
hackney pool timeout
2020-02-21 14:33:55 +03:00
6806df80dd
don't log info ssl messages
2020-02-21 14:28:16 +03:00
ad8f26c0a4
more info in Connections.checkin timout errors
2020-02-21 12:53:40 +03:00
c9db0507f8
removing retry option and changing some logger messages levels
2020-02-19 12:26:57 +03:00
7d73e7a09a
Spelling
2020-02-18 09:18:09 -06:00
514c899275
adding gun adapter
2020-02-18 08:19:01 +03:00
02dc651828
Handle 303 redirects
2019-07-28 20:24:39 +00:00
b001b8891a
Merge the default options with custom ones in ReverseProxy and
...
Pleroma.HTTP
2019-07-12 23:52:26 +03:00
99f70c7e20
Use Pleroma.Config everywhere
2019-05-30 15:33:58 +07:00
9f3bcf0efe
Respect proxy settings federation
2019-05-28 06:49:53 +00:00
c972d0bb14
http: bump connection timeout to 10 seconds
2019-05-21 04:59:15 +00:00
290f5b2cfe
config: make sending the user agent configurable, disable sending the user agent in tests
2019-05-17 20:28:58 +00:00
d3b8cd342f
http: request builder: send user-agent when making requests
2019-05-17 19:04:17 +00:00
1f78d23eed
http: connection: unify adapter configuration and defaults
2019-03-08 22:59:10 +00:00
ba48bd901c
http: connection: relax the timeouts a little
2019-03-08 22:56:16 +00:00
19afd9f81f
http: rework connection timeouts to match hackney docs, enforce 1 second max TCP connection timeout
2019-03-08 22:56:16 +00:00
773f532b14
http: actually pass the options list to the Connection factory
2019-03-08 22:56:16 +00:00
50ba4ba2c9
http: connection: merge hackney option lists instead of concatenating them
...
this ensures the right pools are used
2019-03-08 22:56:16 +00:00
2a83c0ba93
http: safely catch erlang exits and elixir errors from hackney (ref #672 )
2019-03-08 22:56:16 +00:00
b57913b13a
Fix supported TLS versions as TLS 1.3 support seems buggy.
2019-03-04 11:30:26 +01:00
4aff4efa8d
Use multiple hackney pools
...
* federation (ap, salmon)
* media (rich media, media proxy)
* upload (uploader proxy)
Each "part" will stop fighting others ones -- a huge federation outbound
could before make the media proxy fail to checkout a connection in time.
splitted media and uploaded media for the good reason than an upload
pool will have all connections to the same host (the uploader upstream).
it also has a longer default retention period for connections.
2019-01-30 15:06:46 +01:00
rinpatch