I just installed Jenkins. I have all default plugins installed. I even configured the SMTP credentials and tried sending a test mail. All works fine now.
Now in post build step, I have an option to send an email. But, I can send email only when the build is failed or the build is back to normal. It does not have an option to allow me to send an email when build passes.