Activation Functions

This page contains the list of all activation functions supported in Echo.

Echo contains implementation for following activation functions (✅ - implemented functions, 🕑 - functions to be implemented soon, ⬜ - function is implemented in the original deep learning package):

#

Function

PyTorch

TensorFlow

MegEngine

1

✅

✅

✅

2

✅

✅

✅

3

✅

✅

✅

4

✅

✅

✅

5

✅

✅

✅

6

✅

✅

✅

7

✅

✅

✅

8

✅

✅

✅

9

✅

✅

✅

10

✅

✅

✅

11

✅

✅

✅

12

✅

✅

✅

13

✅

✅

🕑

14

✅

✅

🕑

15

✅

✅

✅

16

✅

✅

🕑

17

⬜

🕑

🕑

18

⬜

✅

🕑

19

⬜

🕑

🕑

20

✅

✅

🕑

21

🕑

✅

🕑

22

🕑

🕑

🕑

23

🕑

🕑

🕑

24

✅

✅

🕑

25

✅

🕑

✅

26

🕑

🕑

🕑

27

✅

🕑

🕑

28

✅

🕑

🕑

29

✅

🕑

🕑

30

✅

🕑

🕑

31

🕑

🕑

🕑

32

🕑

🕑

🕑

35

✅

🕑

🕑

36

✅

🕑

🕑

37

✅

🕑

🕑

38

🕑

🕑

🕑

39

🕑

🕑

🕑

40

🕑

🕑

🕑

41

🕑

🕑

🕑

42

🕑

🕑

🕑

43

✅

🕑

🕑

44

✅

🕑

🕑

45

✅

🕑

🕑

46

✅

🕑

🕑

47

✅

🕑

🕑

48

✅

🕑

🕑

PreviousInstallation NextPyTorch

Last updated 4 years ago

Was this helpful?