Fuchsia software is delivered on demand to the system through packages. This is a critical component to Fuchsia's core design principles of security and updatability. Packages can be updated independently and delivered on demand, like a web page. This enables a vulnerability patch to be pushed to all Fuchsia products at once without the need for individual product coordination.
A package is not a single archive or image file, but rather a tree of Binary Large Objects (BLOBs). The root of the tree is a BLOB called "meta.far" which contains metadata for the package, including a "meta/contents" file which contains references to the rest of the BLOBs. The BLOBs inside Fuchsia packages are content-addressed, meaning they are referenced using a hash of their contents. The content address of the meta.far itself is known as the package hash.
The meta.far contains a
meta/ directory with at least the
following two items:
meta/package: JSON file containing the package's identity information such as name and version.
meta/contents: A map of the human-readable file names in a package to their content addresses.
If two or more packages share the same content (such as a library dependency, or font resource), their metadata will point to the same content address for that resource. This enables Fuchsia to optimize package distribution and storage by avoiding the need to fetch and save a content BLOB that already exists.
Hosting and serving packages
Packages are hosted in repositories based on The Update Framework (TUF). This framework is a specification designed to enable secure delivery of software updates. TUF repositories secure updates through signed metadata attached to records that are verifiable against known trusted public and private keys. This means that any HTTP server can serve a TUF repository without the need for transport-level security, including a developer's workstation!
Packages within a repository are identified by a URL with the
repo-hostname: Hostname of a trusted package repository, such as
pkg-name: Unique identifier for the package in this repository.
resource-path: Resource contained within the package, such as a component manifest.
Requests for software on a Fuchsia device are handled by the package resolver. The package resolver determines if the system already has the package cached locally. If not, the resolver fetches the meta.far from the repository and updates the necessary content BLOBs.
On the device, package BLOBs are stored in a content-addressable filesystem
optimized for write-once, read-often files called
blobfs. This allows them
to be de-duplicated across all packages and
cryptographically verified using their hash. Fuchsia runs the
service on top of
blobfs to facilitate package management.
pkg-cache layer tracks which packages in the system are currently
active. Packages are not explicitly installed or removed in Fuchsia.
Software is delivered on demand and likewise space can be reclaimed from
packages that are no longer active through periodic garbage collection.
pkg-cache triggers garbage collection to reclaim space, content BLOBs
not referenced by any active package are deleted.
So far in this codelab, you've been experiencing on demand software delivery to your device and you probably didn't even know it! In this exercise, you'll peel back the covers and see the details of how packages are delivered and stored on a Fuchsia device.
Start the emulator
If you do not already have an instance running, start FEMU with networking support:
ffx emu start workstation_eng.qemu-x64 --headless
Examine the system packages
List the package repositories configured in your package server:
ffx repository list
This command prints output similar to the following:
+--------------------------+------+-----------------------------------------------+ | NAME | TYPE | EXTRA | +==========================+======+===============================================+ | workstation-packages | pm | /home/alice/.local/share/Fuchsia/.../packages | +--------------------------+------+-----------------------------------------------+
workstation-packages repository is created when you run the
ffx product-bundle get command (previously in "Get started with the Fuchsia SDK"
quickstart guide). This repository contains additional system packages for the
workstation_eng.qemu-x64 prebuilt image.
With the local package server running, you can explore the list of packages that are available in the repository:
ffx repository package list -r workstation-packages
This command prints additional details about each package in the repository, including the individual components.
Monitor package loading
Packages are resolved and loaded on demand by a Fuchsia device. Take a look at
this in action with the
spinning-square example package.
From the device shell prompt, you can confirm whether a known package is currently on the device:
fssh pkgctl pkg-status fuchsia-pkg://fuchsia.com/spinning-square-rs
Package in registered TUF repo: yes (merkle=ef65e2ed...) Package on disk: no fssh ERROR: Error running ssh: exit status 2
Open a new terminal and begin streaming the device logs for
ffx log --filter pkg-resolver
This shows all the instances where a package was loaded from the package server.
From the device shell prompt, attempt to resolve the package:
fssh pkgctl resolve fuchsia-pkg://fuchsia.com/spinning-square-rs
Notice the new lines added to the log output for
[pkg-resolver][pkg-resolver][I] Fetching blobs for fuchsia-pkg://devhost/spinning-square-rs: [ 6b547fb59fda56866eea01cda90add0aabc1af7c7418c7850011ec6e99a996f1, 7c1a9fd1c11e9b6b1d3c3184cf350cecfc91ec083b412d20c18b5187d0983d88, ] [pkg-resolver][pkg-resolver][I] resolved fuchsia-pkg://fuchsia.com/spinning-square-rs as fuchsia-pkg://devhost/spinning-square-rs to 21967ecc643257800b8ca14420c7f023c1ede7a76068da5faedf328f9d9d3649 with TUF
From the device shell prompt, check the package status again on the device:
fssh pkgctl pkg-status fuchsia-pkg://fuchsia.com/spinning-square-rs
Package in registered TUF repo: yes (merkle=ef65e2ed...) Package on disk: yes (path=/pkgfs/versions/ef65e2ed...)
Fuchsia resolved the package and loaded it from the local TUF repository on demand!
Explore package metadata
Now that the
spinning-square package has successfully been resolved, you can
explore the package contents. Once resolved, the package is referenced on the
target device using its content address.
From the device shell prompt, use the
pkgctl get-hash command to determine the
package hash for
fssh pkgctl get-hash fuchsia-pkg://fuchsia.com/spinning-square-rs
Provide the full package hash to the
pkgctl open command to view the package
fssh pkgctl open ef65e2ed...
opening ef65e2ed... package contents: /bin/spinning_square /lib/VkLayer_khronos_validation.so /lib/ld.so.1 /lib/libasync-default.so /lib/libbackend_fuchsia_globals.so /lib/libc++.so.2 /lib/libc++abi.so.1 /lib/libfdio.so /lib/librust-trace-provider.so /lib/libstd-e3c06c8874beb723.so /lib/libsyslog.so /lib/libtrace-engine.so /lib/libunwind.so.1 /lib/libvulkan.so /meta/contents /meta/package /meta/spinning-square-rs.cm /meta/spinning-square-rs.cmx /data/fonts/RobotoSlab-Regular.ttf /meta/fuchsia.abi/abi-revision /data/vulkan/explicit_layer.d/VkLayer_khronos_validation.json
This lists the package metadata and each of the content BLOBs in the package.
You can see
bin/ entries for executables,
lib/ entries for shared library
dependencies, additional metadata and resources.
Congratulations! You now have a better understanding of what makes Fuchsia unique and the goals driving this new platform's design.
In the next module, you'll learn more about building Fuchsia's fundamental unit of software: