setproduct Function
The setproduct
function finds all of the possible combinations of elements
from all of the given sets by computing the
Cartesian product.
setproduct(sets...)
This function is particularly useful for finding the exhaustive set of all combinations of members of multiple sets, such as per-application-per-environment resources.
> setproduct(["development", "staging", "production"], ["app1", "app2"])[ [ "development", "app1", ], [ "development", "app2", ], [ "staging", "app1", ], [ "staging", "app2", ], [ "production", "app1", ], [ "production", "app2", ],]
You must past at least two arguments to this function.
Although defined primarily for sets, this function can also work with lists. If all of the given arguments are lists then the result is a list, preserving the ordering of the given lists. Otherwise the result is a set. In either case, the result's element type is a list of values corresponding to each given argument in turn.
Examples
There is an example of the common usage of this function above. There are some other situations that are less common when hand-writing but may arise in reusable folder situations.
If any of the arguments is empty then the result is always empty itself, similar to how multiplying any number by zero gives zero:
> setproduct(["development", "staging", "production"], [])[]
Similarly, if all of the arguments have only one element then the result has only one element, which is the first element of each argument:
> setproduct(["a"], ["b"])[ [ "a", "b", ],]
Each argument must have a consistent type for all of its elements. If not, Packer will attempt to convert to the most general type, or produce an error if such a conversion is impossible. For example, mixing both strings and numbers results in the numbers being converted to strings so that the result elements all have a consistent type:
> setproduct(["staging", "production"], ["a", 2])[ [ "staging", "a", ], [ "staging", "2", ], [ "production", "a", ], [ "production", "2", ],]
Finding combinations for for_each
The
resource for_each
and
dynamic
block
language features both require a collection value that has one element for
each repetition.
Sometimes your input data comes in separate values that cannot be directly
used in a for_each
argument, and setproduct
can be a useful helper function
for the situation where you want to find all unique combinations of elements in
a number of different collections.
For example, consider a folder that declares variables like the following:
variable "networks" { type = map(object({ base_cidr_block = string }))} variable "subnets" { type = map(object({ number = number }))}
If the goal is to create each of the defined subnets per each of the defined
networks, creating the top-level networks can directly use var.networks
because it's already in a form where the resulting instances match one-to-one
with map elements:
resource "aws_vpc" "example" { for_each = var.networks cidr_block = each.value.base_cidr_block}
However, in order to declare all of the subnets with a single resource
block, we must first produce a collection whose elements represent all of
the combinations of networks and subnets, so that each element itself
represents a subnet:
locals { # setproduct works with sets and lists, but our variables are both maps # so we'll need to convert them first. networks = [ for key, network in var.networks : { key = key cidr_block = network.cidr_block } ] subnets = [ for key, subnet in var.subnets : { key = key number = subnet.number } ] network_subnets = [ # in pair, element zero is a network and element one is a subnet, # in all unique combinations. for pair in setproduct(local.networks, local.subnets) : { network_key = pair[0].key subnet_key = pair[1].key network_id = aws_vpc.example[pair[0].key].id # The cidr_block is derived from the corresponding network. See the # cidrsubnet function for more information on how this calculation works. cidr_block = cidrsubnet(pair[0].cidr_block, 4, pair[1].number) } ]} resource "aws_subnet" "example" { # local.network_subnets is a list, so we must now project it into a map # where each key is unique. We'll combine the network and subnet keys to # produce a single unique key per instance. for_each = { for subnet in local.network_subnets : "${subnet.network_key}.${subnet.subnet_key}" => subnet } vpc_id = each.value.network_id availability_zone = each.value.subnet_key cidr_block = each.value_cidr_block}
The above results in one subnet instance per combination of network and subnet elements in the input variables.
Related Functions
contains
tests whether a given list or set contains a given element value.flatten
is useful for flattening hierarchical data into a single list, for situations where the relationships between two object types are defined explicitly.setintersection
computes the intersection of multiple sets.setunion
computes the union of multiple sets.