From lgatr v1 to v2
The lgatr v2 release renames parts of the interface, mostly to make names consistent
between the LGATr and LGATrSlim
architectures. The concrete changes are:
ConditionalLGATrandConditionalLGATrSlim__init__arguments:condition_mv_channels→mv_channels_condcondition_v_channels→v_channels_condcondition_s_channels→s_channels_cond
and
forwardarguments:multivectors_condition→multivectors_condvectors_condition→vectors_condscalars_condition→scalars_cond
-
activation→nonlinearityincrease_hidden_channels→mlp_rationum_hidden_layers→num_layers_mlp(num_layers_mlpcounts all layers instead of only the hidden ones, so explicit values have to be increased by one if the parameter is specified)
SelfAttentionConfigandCrossAttentionConfig:increase_hidden_channels→attn_ratio.
The global
gatr_configobject is replaced byPrimitivesConfig, which is passed to each network asprimitives. This way several networks with different settings can coexist. The flags are renamed:use_fully_connected_subgroup→subgroupuse_bivector→bivectoruse_geometric_product→geometric_product
The
compile_modeandcompile_dynamicarguments are replaced by a singlecompile_kwargsdict that is passed on totorch.compile(). Note thatdynamicis not enabled by default anymore, usecompile_kwargs={"dynamic": True}to recover the v1 behavior.