Advanced Lifetimes - The Rust Programming Language

## Advanced Lifetimes

In Chapter 10 in the “Validating References with Lifetimes” section, you learned how to annotate references with lifetime parameters to tell Rust how lifetimes of different references relate. You saw how every reference has a lifetime, but most of the time, Rust will let you elide lifetimes. Now we’ll look at three advanced features of lifetimes that we haven’t covered yet:

- Lifetime subtyping: ensures that one lifetime outlives another lifetime
- Lifetime bounds: specifies a lifetime for a reference to a generic type
- Inference of trait object lifetimes: allows the compiler to infer trait object lifetimes and when they need to be specified

### Ensuring One Lifetime Outlives Another with Lifetime Subtyping

Lifetime subtyping specifies that one lifetime should outlive another lifetime. To explore lifetime subtyping, imagine we want to write a parser. We’ll use a structure called `Context` that holds a reference to the string we’re parsing. We’ll write a parser that will parse this string and return success or failure. The parser will need to borrow the `Context` to do the parsing. Listing 19-12 implements this parser code, except the code doesn’t have the required lifetime annotations, so it won’t compile.

Filename: src/lib.rs

    struct Context(&str);

    struct Parser {
        context: &Context,
    }

    impl Parser {
        fn parse(&self) -> Result<(), &str> {
            Err(&self.context.0[1..])
        }
    }

Listing 19-12: Defining a parser without lifetime annotations

Compiling the code results in errors because Rust expects lifetime parameters on the string slice in `Context` and the reference to a `Context` in `Parser`.

For simplicity’s sake, the `parse` function returns `Result<(), &str>`. That is, the function will do nothing on success and, on failure, will return the part of the string slice that didn’t parse correctly. A real implementation would provide more error information and would return a structured data type when parsing succeeds. We won’t be discussing those details because they aren’t relevant to the lifetimes part of this example.

To keep this code simple, we won’t write any parsing logic. However, it’s very likely that somewhere in the parsing logic we would handle invalid input by returning an error that references the part of the input that is invalid; this reference is what makes the code example interesting in regard to lifetimes. Let’s pretend that the logic of our parser is that the input is invalid after the first byte. Note that this code might panic if the first byte is not on a valid character boundary; again, we’re simplifying the example to focus on the lifetimes involved.

To get this code to compile, we need to fill in the lifetime parameters for the string slice in `Context` and the reference to the `Context` in `Parser`. The most straightforward way to do this is to use the same lifetime name everywhere, as shown in Listing 19-13. Recall from the “Lifetime Annotations in Struct Definitions” section in Chapter 10 that each of `struct Context<'a>`, `struct Parser<'a>`, and `impl<'a>` is declaring a new lifetime parameter. While their names happen to all be the same, the three lifetime parameters declared in this example aren’t related.

Filename: src/lib.rs

    # #![allow(unused_variables)]
    #fn main() {
    struct Context<'a>(&'a str);

    struct Parser<'a> {
        context: &'a Context<'a>,
    }

    impl<'a> Parser<'a> {
        fn parse(&self) -> Result<(), &str> {
            Err(&self.context.0[1..])
        }
    }
    #}

Listing 19-13: Annotating all references in `Context` and `Parser` with lifetime parameters

This code compiles just fine. It tells Rust that a `Parser` holds a reference to a `Context` with lifetime `'a` and that `Context` holds a string slice that also lives as long as the reference to the `Context` in `Parser`. Rust’s compiler error message stated that lifetime parameters were required for these references, and we’ve now added lifetime parameters.

Next, in Listing 19-14, we’ll add a function that takes an instance of `Context`, uses a `Parser` to parse that context, and returns what `parse` returns. This code doesn’t quite work.

Filename: src/lib.rs

    fn parse_context(context: Context) -> Result<(), &str> {
        Parser { context: &context }.parse()
    }

Listing 19-14: An attempt to add a `parse_context` function that takes a `Context` and uses a `Parser`

We get two verbose errors when we try to compile the code with the addition of the `parse_context` function:

    error[E0597]: borrowed value does not live long enough
      --> src/lib.rs:14:5
       |
    14 |     Parser { context: &context }.parse()
       |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ does not live long enough
    15 | }
       | - temporary value only lives until here
       |
    note: borrowed value must be valid for the anonymous lifetime #1 defined on the function body at 13:1...
      --> src/lib.rs:13:1
       |
    13 | / fn parse_context(context: Context) -> Result<(), &str> {
    14 | |     Parser { context: &context }.parse()
    15 | | }
       | |_^

    error[E0597]: `context` does not live long enough
      --> src/lib.rs:14:24
       |
    14 |     Parser { context: &context }.parse()
       |                        ^^^^^^^ does not live long enough
    15 | }
       | - borrowed value only lives until here
       |
    note: borrowed value must be valid for the anonymous lifetime #1 defined on the function body at 13:1...
      --> src/lib.rs:13:1
       |
    13 | / fn parse_context(context: Context) -> Result<(), &str> {
    14 | |     Parser { context: &context }.parse()
    15 | | }
       | |_^

These errors state that the `Parser` instance that is created and the `context` parameter live only until the end of the `parse_context` function. But they both need to live for the entire lifetime of the function.

In other words, `Parser` and `context` need to outlive the entire function and be valid before the function starts as well as after it ends for all the references in this code to always be valid. The `Parser` we’re creating and the `context` parameter go out of scope at the end of the function, because `parse_context` takes ownership of `context`.

To figure out why these errors occur, let’s look at the definitions in Listing 19-13 again, specifically the references in the signature of the `parse` method:

        fn parse(&self) -> Result<(), &str> {

Remember the elision rules? If we annotate the lifetimes of the references rather than eliding, the signature would be as follows:

        fn parse<'a>(&'a self) -> Result<(), &'a str> {

That is, the error part of the return value of `parse` has a lifetime that is tied to the lifetime of the `Parser` instance (that of `&self` in the `parse` method signature). That makes sense: the returned string slice references the string slice in the `Context` instance held by the `Parser`, and the definition of the `Parser` struct specifies that the lifetime of the reference to `Context` and the lifetime of the string slice that `Context` holds should be the same.

The problem is that the `parse_context` function returns the value returned from `parse`, so the lifetime of the return value of `parse_context` is tied to the lifetime of the `Parser` as well. But the `Parser` instance created in the `parse_context` function won’t live past the end of the function (it’s temporary), and `context` will go out of scope at the end of the function (`parse_context` takes ownership of it).

Rust thinks we’re trying to return a reference to a value that goes out of scope at the end of the function, because we annotated all the lifetimes with the same lifetime parameter. The annotations told Rust the lifetime of the string slice that `Context` holds is the same as that of the lifetime of the reference to `Context` that `Parser` holds.

The `parse_context` function can’t see that within the `parse` function, the string slice returned will outlive `Context` and `Parser` and that the reference `parse_context` returns refers to the string slice, not to `Context` or `Parser`.

By knowing what the implementation of `parse` does, we know that the only reason the return value of `parse` is tied to the `Parser` instance is that it’s referencing the `Parser` instance’s `Context`, which is referencing the string slice. So, it’s really the lifetime of the string slice that `parse_context` needs to care about. We need a way to tell Rust that the string slice in `Context` and the reference to the `Context` in `Parser` have different lifetimes and that the return value of `parse_context` is tied to the lifetime of the string slice in `Context`.

First, we’ll try giving `Parser` and `Context` different lifetime parameters, as shown in Listing 19-15. We’ll use `'s` and `'c` as lifetime parameter names to clarify which lifetime goes with the string slice in `Context` and which goes with the reference to `Context` in `Parser`. Note that this solution won’t completely fix the problem, but it’s a start. We’ll look at why this fix isn’t sufficient when we try to compile.

Filename: src/lib.rs

    struct Context<'s>(&'s str);

    struct Parser<'c, 's> {
        context: &'c Context<'s>,
    }

    impl<'c, 's> Parser<'c, 's> {
        fn parse(&self) -> Result<(), &'s str> {
            Err(&self.context.0[1..])
        }
    }

    fn parse_context(context: Context) -> Result<(), &str> {
        Parser { context: &context }.parse()
    }

Listing 19-15: Specifying different lifetime parameters for the references to the string slice and to `Context`

We’ve annotated the lifetimes of the references in all the same places that we annotated them in Listing 19-13. But this time we used different parameters depending on whether the reference goes with the string slice or with `Context`. We’ve also added an annotation to the string slice part of the return value of `parse` to indicate that it goes with the lifetime of the string slice in `Context`.

When we try to compile now, we get the following error:

    error[E0491]: in type `&'c Context<'s>`, reference has a longer lifetime than the data it references
     --> src/lib.rs:4:5
      |
    4 |     context: &'c Context<'s>,
      |     ^^^^^^^^^^^^^^^^^^^^^^^^
      |
    note: the pointer is valid for the lifetime 'c as defined on the struct at 3:1
     --> src/lib.rs:3:1
      |
    3 | / struct Parser<'c, 's> {
    4 | |     context: &'c Context<'s>,
    5 | | }
      | |_^
    note: but the referenced data is only valid for the lifetime 's as defined on the struct at 3:1
     --> src/lib.rs:3:1
      |
    3 | / struct Parser<'c, 's> {
    4 | |     context: &'c Context<'s>,
    5 | | }
      | |_^

Rust doesn’t know of any relationship between `'c` and `'s`. To be valid, the referenced data in `Context` with lifetime `'s` needs to be constrained to guarantee that it lives longer than the reference with lifetime `'c`. If `'s` is not longer than `'c`, the reference to `Context` might not be valid.

Now we get to the point of this section: the Rust feature lifetime subtyping specifies that one lifetime parameter lives at least as long as another one. In the angle brackets where we declare lifetime parameters, we can declare a lifetime `'a` as usual and declare a lifetime `'b` that lives at least as long as `'a` by declaring `'b` using the syntax `'b: 'a`.

In our definition of `Parser`, to say that `'s` (the lifetime of the string slice) is guaranteed to live at least as long as `'c` (the lifetime of the reference to `Context`), we change the lifetime declarations to look like this:

Filename: src/lib.rs

    # #![allow(unused_variables)]
    #fn main() {
    # struct Context<'a>(&'a str);
    #
    struct Parser<'c, 's: 'c> {
        context: &'c Context<'s>,
    }
    #}

Now the reference to `Context` in the `Parser` and the reference to the string slice in the `Context` have different lifetimes; we’ve ensured that the lifetime of the string slice is longer than the reference to the `Context`.

That was a very long-winded example, but as we mentioned at the start of this chapter, Rust’s advanced features are very specific. You won’t often need the syntax we described in this example, but in such situations, you’ll know how to refer to something and give it the necessary lifetime.

### Lifetime Bounds on References to Generic Types

In the “Trait Bounds” section in Chapter 10, we discussed using trait bounds on generic types. We can also add lifetime parameters as constraints on generic types; these are called lifetime bounds. Lifetime bounds help Rust verify that references in generic types won’t outlive the data they’re referencing.

As an example, consider a type that is a wrapper over references. Recall the `RefCell<T>` type from the “`RefCell<T>` and the Interior Mutability Pattern” section in Chapter 15: its `borrow` and `borrow_mut` methods return the types `Ref` and `RefMut`, respectively. These types are wrappers over references that keep track of the borrowing rules at runtime. The definition of the `Ref` struct is shown in Listing 19-16, without lifetime bounds for now.

Filename: src/lib.rs

    struct Ref<'a, T>(&'a T);

Listing 19-16: Defining a struct to wrap a reference to a generic type, without lifetime bounds

Without explicitly constraining the lifetime `'a` in relation to the generic parameter `T`, Rust will error because it doesn’t know how long the generic type `T` will live:

    error[E0309]: the parameter type `T` may not live long enough
     --> src/lib.rs:1:19
      |
    1 | struct Ref<'a, T>(&'a T);
      |                   ^^^^^^
      |
      = help: consider adding an explicit lifetime bound `T: 'a`...
    note: ...so that the reference type `&'a T` does not outlive the data it points at
     --> src/lib.rs:1:19
      |
    1 | struct Ref<'a, T>(&'a T);
      |                   ^^^^^^

Because `T` can be any type, `T` could be a reference or a type that holds one or more references, each of which could have their own lifetimes. Rust can’t be sure `T` will live as long as `'a`.

Fortunately, the error provides helpful advice on how to specify the lifetime bound in this case:

    consider adding an explicit lifetime bound `T: 'a` so that the reference type
    `&'a T` does not outlive the data it points at

Listing 19-17 shows how to apply this advice by specifying the lifetime bound when we declare the generic type `T`.

    # #![allow(unused_variables)]
    #fn main() {
    struct Ref<'a, T: 'a>(&'a T);
    #}

Listing 19-17: Adding lifetime bounds on `T` to specify that any references in `T` live at least as long as `'a`

This code now compiles because the `T: 'a` syntax specifies that `T` can be any type, but if it contains any references, the references must live at least as long as `'a`.

We could solve this problem in a different way, as shown in the definition of a `StaticRef` struct in Listing 19-18, by adding the `'static` lifetime bound on `T`. This means if `T` contains any references, they must have the `'static` lifetime.

    # #![allow(unused_variables)]
    #fn main() {
    struct StaticRef<T: 'static>(&'static T);
    #}

Listing 19-18: Adding a `'static` lifetime bound to `T` to constrain `T` to types that have only `'static` references or no references

Because `'static` means the reference must live as long as the entire program, a type that contains no references meets the criteria of all references living as long as the entire program (because there are no references). For the borrow checker concerned about references living long enough, there is no real distinction between a type that has no references and a type that has references that live forever: both are the same for determining whether or not a reference has a shorter lifetime than what it refers to.

### Inference of Trait Object Lifetimes

In Chapter 17 in the “Using Trait Objects that Allow for Values of Different Types” section, we discussed trait objects, consisting of a trait behind a reference, that allow us to use dynamic dispatch. We haven’t yet discussed what happens if the type implementing the trait in the trait object has a lifetime of its own. Consider Listing 19-19 where we have a trait `Red` and a struct `Ball`. The `Ball` struct holds a reference (and thus has a lifetime parameter) and also implements trait `Red`. We want to use an instance of `Ball` as the trait object `Box<Red>`.

Filename: src/main.rs

    trait Red { }

    struct Ball<'a> {
        diameter: &'a i32,
    }

    impl<'a> Red for Ball<'a> { }

    fn main() {
        let num = 5;

        let obj = Box::new(Ball { diameter: &num }) as Box<Red>;
    }

Listing 19-19: Using a type that has a lifetime parameter with a trait object

This code compiles without any errors, even though we haven’t explicitly annotated the lifetimes involved in `obj`. This code works because there are rules for working with lifetimes and trait objects:

- The default lifetime of a trait object is `'static`.
- With `&'a Trait` or `&'a mut Trait`, the default lifetime of the trait object is `'a`.
- With a single `T: 'a` clause, the default lifetime of the trait object is `'a`.
- With multiple clauses like `T: 'a`, there is no default lifetime; we must be explicit.

When we must be explicit, we can add a lifetime bound on a trait object like `Box<Red>` using the syntax `Box<Red + 'static>` or `Box<Red + 'a>`, depending on whether the reference lives for the entire program or not. As with the other bounds, the syntax adding a lifetime bound means that any implementor of the `Red` trait that has references inside the type must have the same lifetime specified in the trait object bounds as those references.

Next, let’s look at some other advanced features that manage traits.