Skip to main content

ProxyCachePlugin

Struct ProxyCachePlugin 

Source
pub struct ProxyCachePlugin {
    role: Role,
    id: String,
    cache_key: Vec<Template>,
    cache_ttl: Duration,
    cache_statuses: Vec<u16>,
    cache_methods: Vec<String>,
    hide_cache_headers: bool,
    cache: Arc<dyn ResponseCache>,
    backend_label: &'static str,
    store_label: String,
    max_object_bytes: usize,
    resources: Arc<PluginResources>,
}
Expand description

One node of a proxy-cache lookup/store pair.

Holds a handle to the configured ResponseCache backend; the key is derived per request from cache_key, namespaced by id.

Fields§

§role: Role§id: String

Shared cache namespace — links the lookup and store nodes.

§cache_key: Vec<Template>

Cache-key components, each rendered (supports {{namespace.path}} references and legacy $var interpolation — see Template::render_with_legacy) and joined per request.

§cache_ttl: Duration

Freshness lifetime for stored entries.

§cache_statuses: Vec<u16>

Response statuses eligible for caching.

§cache_methods: Vec<String>

HTTP methods eligible for caching (uppercase).

§hide_cache_headers: bool

When set, hides upstream cache headers from served cache hits.

§cache: Arc<dyn ResponseCache>

The backend this node pair shares, chosen by policy: the process-local cache for local, or a shared RedisResponseCache over a declared stores: entry for redis.

§backend_label: &'static str

Label for the backend dimension of cache_events.

§store_label: String

Label for the store dimension of cache_events: the declared store’s name for policy: redis, empty for policy: local (which has no store to name).

§max_object_bytes: usize

A response body larger than this is served but never cached — one large response must not be able to fill a store that sessions, counters and ACME also live in.

§resources: Arc<PluginResources>

Process-wide services, held for the metrics registry.

Implementations§

Source§

impl ProxyCachePlugin

Source

pub fn from_config( config: &HashMap<String, Value>, resources: &Arc<PluginResources>, ) -> Result<Self, String>

Builds one node of the pair from node config.

Accepted keys:

  • phase / role (string, required): lookup (before upstream) or store (after upstream).
  • id (string, required): shared cache namespace; the lookup and store nodes of one pair must use the same id.
  • cache_key (array of string templates or a single string, default ["$request_method", "$host", "$uri"]): components rendered (supports {{namespace.path}} references plus legacy $var interpolation — see crate::vars::template::Template::render_with_legacy) and joined to form the key. Both nodes must configure it identically.
  • cache_ttl (integer seconds, default 300): freshness lifetime.
  • cache_http_statuses (array, default [200, 301, 404]): statuses eligible for caching. (cache_http_status, APISIX’s singular spelling, is also accepted.)
  • cache_method (array, default ["GET", "HEAD"]): cacheable methods.
  • hide_cache_headers (bool, default false): strip cache-control / expires from served cache hits.
  • max_object_bytes (integer, default 1048576): responses larger than this are served normally but never cached, in either backend.
# before upstream
type: proxy-cache
config:
  phase: lookup
  id: catalog
  cache_key: ["$request_method", "$host", "$uri"]
  cache_ttl: 300
---
# after upstream
type: proxy-cache
config:
  phase: store
  id: catalog
  cache_key: ["$request_method", "$host", "$uri"]
  cache_ttl: 300
  cache_http_statuses: [200, 301, 404]
Source

fn method_cacheable(&self, ctx: &Context) -> bool

Whether this request’s method is cacheable.

Source

fn derive_key(&self, ctx: &Context) -> String

Derives the cache key: id namespace + cache_key components (each rendered via {{namespace.path}} references plus legacy $var interpolation) joined by a control-char separator (outside the character set of any header/method/path, so components can’t collide).

Source

fn record(&self, event: &str)

Counts one cache outcome. A no-op when metrics are disabled (unit tests).

Source§

impl ProxyCachePlugin

Source

async fn run_purge( &self, ctx: Context, ) -> Result<PluginOutput, PluginExecutionError>

Invalidates this node’s pair, independent of request method or cache key – a purge acts on the shared id namespace, not on one derived key, so neither concept applies here.

Trait Implementations§

Source§

impl Plugin for ProxyCachePlugin

Source§

fn cache_target(&self) -> Option<CacheTarget>

A purge-only policy still names a real backend for its id: dedup in collect_targets makes a duplicate target (from a paired lookup/store half also naming it) harmless, and the alternative – None here – would make DELETE /api/cache/{id} 404 for an id only a purge half names, which is worse than the actual consequence: it 200s with removed: 0 when nothing else has ever cached under that id.

Source§

fn reads_response_body(&self) -> bool

Only Lookup opts out of buffering. It never reads the existing response body – on a hit it replaces ctx.response outright with the cached entry, on a miss it passes the context through untouched – and it never returns Err from execute: its only fallible call (self.cache.get) is matched and degraded to a miss, not propagated.

Store reads ctx.response.body to cache it, so it must buffer.

Purge reads nothing from the response either, but is deliberately kept buffering anyway: it can return Err from execute (run_purge, on a failed backend), and the engine’s forward streaming walk (infer_stream_capability in src/graph/engine.rs) is only sound for opt-out nodes that never do that – see the safety argument in its doc comment. Opting Purge out too would let a stream-capable upstream’s response stay live past a purge node that then routes to error, exactly the stale-response.stream-beside-a- generated-body case that invariant exists to rule out.

Source§

fn plugin_type(&self) -> &str

Unique identifier for the plugin type (e.g., “proxy-rewrite”, “upstream”). This is also the key its PortSpec is registered under in port_spec.
Source§

fn execute<'life0, 'async_trait>( &'life0 self, ctx: Context, ) -> Pin<Box<dyn Future<Output = Result<PluginOutput, PluginExecutionError>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait,

Executes the plugin logic against the request/response context. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
§

impl<'a, T, E> AsTaggedExplicit<'a, E> for T
where T: 'a,

§

fn explicit(self, class: Class, tag: u32) -> TaggedParser<'a, Explicit, Self, E>

§

impl<'a, T, E> AsTaggedImplicit<'a, E> for T
where T: 'a,

§

fn implicit( self, class: Class, constructed: bool, tag: u32, ) -> TaggedParser<'a, Implicit, Self, E>

Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
§

impl<T> MaybeSend for T

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more