Melt butter in a medium saucepan; add sweetened condensed milk and cook until it changes color slightly. Stir in white chocolate and orange peel until smooth.
Line a small rectangular pan with waxed paper. Sprinkle 1/2 cup almonds on bottom of dish; pour white chocolate mixture over the almonds. Sprinkle with remaining 1/2 cup almonds. Refrigerate for 40 minutes. Remove from pan and cut into squares.