Skip Connections

• Output of conv, c, layers are added to inputs of UpConv, d, layers
• Element-wise, not channel appending
• Propagate high frequency information to later layers
• Two types
  • Additive
    • ResNet
    • Super-Resolution auto-encoder
• Concatenative
  • Densely connected architectures
  • DenseNet
  • FlowNet

AI Summer - Skip Connections Arxiv - Visualising the Loss Landscape