Index

_

__call__() (sonnet.BaseBatchNorm method) (sonnet.BatchApply method) (sonnet.Bias method) (sonnet.Deferred method) (sonnet.DepthwiseConv2D method) (sonnet.Embed method) (sonnet.GroupNorm method) (sonnet.GRU method) (sonnet.initializers.Constant method) (sonnet.initializers.Identity method) (sonnet.initializers.Initializer method) (sonnet.initializers.Ones method) (sonnet.initializers.Orthogonal method) (sonnet.initializers.RandomNormal method) (sonnet.initializers.RandomUniform method) (sonnet.initializers.TruncatedNormal method) (sonnet.initializers.VarianceScaling method) (sonnet.initializers.Zeros method) (sonnet.LayerNorm method) (sonnet.Linear method) (sonnet.LSTM method) (sonnet.Metric method) (sonnet.nets.Cifar10ConvNet method) (sonnet.nets.MLP method) (sonnet.nets.ResNet method) (sonnet.nets.VectorQuantizer method) (sonnet.nets.VectorQuantizerEMA method) (sonnet.regularizers.L1 method) (sonnet.regularizers.L2 method) (sonnet.regularizers.OffDiagonalOrthogonal method) (sonnet.regularizers.Regularizer method) (sonnet.Reshape method) (sonnet.RNNCore method) (sonnet.TrainableState method) (sonnet.UnrolledLSTM method) (sonnet.UnrolledRNN method) (sonnet.VanillaRNN method) __delattr__() (sonnet.Deferred method) __init__() (sonnet.BaseBatchNorm method) (sonnet.BatchApply method) (sonnet.BatchNorm method) (sonnet.Bias method) (sonnet.Conv1D method) (sonnet.Conv1DLSTM method) (sonnet.Conv1DTranspose method) (sonnet.Conv2D method) (sonnet.Conv2DLSTM method) (sonnet.Conv2DTranspose method) (sonnet.Conv3D method) (sonnet.Conv3DLSTM method) (sonnet.Conv3DTranspose method) (sonnet.DeepRNN method) (sonnet.Deferred method) (sonnet.DepthwiseConv2D method) (sonnet.distribute.CrossReplicaBatchNorm method) (sonnet.Embed method) (sonnet.Flatten method) (sonnet.GroupNorm method) (sonnet.GRU method) (sonnet.initializers.Constant method) (sonnet.initializers.Identity method) (sonnet.initializers.Orthogonal method) (sonnet.initializers.RandomNormal method) (sonnet.initializers.RandomUniform method) (sonnet.initializers.TruncatedNormal method) (sonnet.initializers.VarianceScaling method) (sonnet.InstanceNorm method) (sonnet.LayerNorm method) (sonnet.Linear method) (sonnet.LSTM method) (sonnet.Mean method) (sonnet.Module method) (sonnet.nets.Cifar10ConvNet method) (sonnet.nets.MLP method) (sonnet.nets.ResNet method) (sonnet.nets.ResNet50 method) (sonnet.nets.VectorQuantizer method) (sonnet.nets.VectorQuantizerEMA method) (sonnet.optimizers.Adam method) (sonnet.optimizers.Momentum method) (sonnet.optimizers.RMSProp method) (sonnet.optimizers.SGD method) (sonnet.regularizers.L1 method) (sonnet.regularizers.L2 method) (sonnet.regularizers.OffDiagonalOrthogonal method) (sonnet.Reshape method) (sonnet.Sum method) (sonnet.TrainableState method) (sonnet.UnrolledLSTM method) (sonnet.VanillaRNN method)

__repr__() (sonnet.Deferred method) __str__() (sonnet.Deferred method)

A

accumulated_momentum (sonnet.optimizers.Momentum attribute)

Adam (class in sonnet.optimizers)

B

b (sonnet.Conv1DLSTM attribute) (sonnet.Conv2DLSTM attribute) (sonnet.Conv3DLSTM attribute) (sonnet.GRU attribute) (sonnet.LSTM attribute) (sonnet.VanillaRNN attribute)

BaseBatchNorm (class in sonnet) BatchApply (class in sonnet) BatchNorm (class in sonnet) beta1 (sonnet.optimizers.Adam attribute) beta2 (sonnet.optimizers.Adam attribute) Bias (class in sonnet)

C

causal() (in module sonnet.pad) centered (sonnet.optimizers.RMSProp attribute) Cifar10ConvNet (class in sonnet.nets) commitment_cost (sonnet.nets.VectorQuantizer attribute) (sonnet.nets.VectorQuantizerEMA attribute) Constant (class in sonnet.initializers) Conv1D (class in sonnet) Conv1DLSTM (class in sonnet)

Conv1DTranspose (class in sonnet) Conv2D (class in sonnet) Conv2DLSTM (class in sonnet) Conv2DTranspose (class in sonnet) Conv3D (class in sonnet) Conv3DLSTM (class in sonnet) Conv3DTranspose (class in sonnet) create() (in module sonnet.pad) CrossReplicaBatchNorm (class in sonnet.distribute)

D

decay (sonnet.nets.VectorQuantizerEMA attribute) (sonnet.optimizers.RMSProp attribute) deep_rnn_with_residual_connections() (in module sonnet) deep_rnn_with_skip_connections() (in module sonnet)

DeepRNN (class in sonnet) Deferred (class in sonnet) DepthwiseConv2D (class in sonnet) disable() (in module sonnet.mixed_precision) dynamic_unroll() (in module sonnet)

E

Embed (class in sonnet) embedding_dim (sonnet.nets.VectorQuantizer attribute) (sonnet.nets.VectorQuantizerEMA attribute)

enable() (in module sonnet.mixed_precision) epsilon (sonnet.nets.VectorQuantizerEMA attribute) (sonnet.optimizers.Adam attribute) (sonnet.optimizers.RMSProp attribute)

F

Flatten (class in sonnet) flatten() (in module sonnet)

for_core() (sonnet.TrainableState class method) full() (in module sonnet.pad)

G

GroupNorm (class in sonnet)

GRU (class in sonnet)

H

hidden_to_hidden (sonnet.Conv1DLSTM attribute) (sonnet.Conv2DLSTM attribute) (sonnet.Conv3DLSTM attribute) (sonnet.GRU attribute) (sonnet.LSTM attribute) (sonnet.VanillaRNN attribute)

I

Identity (class in sonnet.initializers) Initializer (class in sonnet.initializers) input_to_hidden (sonnet.Conv1DLSTM attribute) (sonnet.Conv2DLSTM attribute) (sonnet.Conv3DLSTM attribute) (sonnet.GRU attribute) (sonnet.LSTM attribute) (sonnet.VanillaRNN attribute)

InstanceNorm (class in sonnet)

L

L1 (class in sonnet.regularizers) L2 (class in sonnet.regularizers) LayerNorm (class in sonnet) learning_rate (sonnet.optimizers.Adam attribute) (sonnet.optimizers.Momentum attribute) (sonnet.optimizers.RMSProp attribute) (sonnet.optimizers.SGD attribute)

Linear (class in sonnet) LSTM (class in sonnet) lstm_with_recurrent_dropout() (in module sonnet) LSTMState (class in sonnet)

M

m (sonnet.optimizers.Adam attribute) Mean (class in sonnet) Metric (class in sonnet) mg (sonnet.optimizers.RMSProp attribute) MLP (class in sonnet.nets) modes() (in module sonnet.mixed_precision) module sonnet.distribute sonnet.initializers sonnet.mixed_precision sonnet.nets sonnet.optimizers sonnet.pad sonnet.regularizers

Module (class in sonnet) mom (sonnet.optimizers.RMSProp attribute) Momentum (class in sonnet.optimizers) momentum (sonnet.optimizers.Momentum attribute) (sonnet.optimizers.RMSProp attribute) ms (sonnet.optimizers.RMSProp attribute)

N

no_name_scope() (in module sonnet)

num_embeddings (sonnet.nets.VectorQuantizer attribute) (sonnet.nets.VectorQuantizerEMA attribute)

O

OffDiagonalOrthogonal (class in sonnet.regularizers) offset (sonnet.BaseBatchNorm attribute) (sonnet.BatchNorm attribute) (sonnet.distribute.CrossReplicaBatchNorm attribute) (sonnet.GroupNorm attribute) (sonnet.InstanceNorm attribute) (sonnet.LayerNorm attribute)

once() (in module sonnet) Ones (class in sonnet.initializers) Orthogonal (class in sonnet.initializers)

R

RandomNormal (class in sonnet.initializers) RandomUniform (class in sonnet.initializers) Regularizer (class in sonnet.regularizers) Replicator (class in sonnet.distribute) Reshape (class in sonnet) reshape() (in module sonnet)

ResNet (class in sonnet.nets) ResNet50 (class in sonnet.nets) reverse_causal() (in module sonnet.pad) reversed() (sonnet.Reshape method) RMSProp (class in sonnet.optimizers) RNNCore (class in sonnet)

S

same() (in module sonnet.pad) scale (sonnet.BaseBatchNorm attribute) (sonnet.BatchNorm attribute) (sonnet.distribute.CrossReplicaBatchNorm attribute) (sonnet.GroupNorm attribute) (sonnet.InstanceNorm attribute) (sonnet.LayerNorm attribute) scope() (in module sonnet.mixed_precision) (sonnet.distribute.Replicator method) (sonnet.distribute.TpuReplicator method) SGD (class in sonnet.optimizers) sonnet.distribute module sonnet.initializers module

sonnet.mixed_precision module sonnet.nets module sonnet.optimizers module sonnet.pad module sonnet.regularizers module static_unroll() (in module sonnet) step (sonnet.optimizers.Adam attribute) Sum (class in sonnet)

T

target (sonnet.Deferred property) TpuReplicator (class in sonnet.distribute)

trainable_variables (sonnet.Module property) TrainableState (class in sonnet) TruncatedNormal (class in sonnet.initializers)

U

UnrolledLSTM (class in sonnet)

UnrolledRNN (class in sonnet) use_nesterov (sonnet.optimizers.Momentum attribute)

V

v (sonnet.optimizers.Adam attribute) valid() (in module sonnet.pad) value (sonnet.Mean property) (sonnet.Metric property) (sonnet.Sum property)

VanillaRNN (class in sonnet) variables (sonnet.Module property) VarianceScaling (class in sonnet.initializers) VectorQuantizer (class in sonnet.nets) VectorQuantizerEMA (class in sonnet.nets)

Z

Zeros (class in sonnet.initializers)