3. Common Operators

In last chapter, we went over how to implement the basic expressions/operators using tvm operators. This chapter will further describe how to implement the typical operators we will encounter in the deep learning models.

• 3.1. Broadcast Add
  • 3.1.1. Summary
• 3.2. Matrix Multiplication
  • 3.2.1. Summary
• 3.3. Convolution
  • 3.3.1. Padding
  • 3.3.2. Convolution
  • 3.3.3. Summary
• 3.4. Depthwise Convolution
  • 3.4.1. Compute definition
  • 3.4.2. Depthwise Convolution in General
  • 3.4.3. Comparing to Baseline
  • 3.4.4. Summary
• 3.5. Pooling
  • 3.5.1. Compute definition
  • 3.5.2. MXNet Baseline
  • 3.5.3. Summary
• 3.6. Batch Normalization
  • 3.6.1. Compute definition
  • 3.6.2. MXNet Baseline
  • 3.6.3. Summary