This LoginPress add-on is a widget you can use into your blog sidebar. It uses an Ajax way to login via the sidebar. You may need to know HTML/CSS to give it style according to your site even we have styled it in general.
LoginPress – Login Widget changelog
* Bugfix: Invalid Email error message.
* Update: Username Label in widget.
* Compatible: with "LoginPress - Social Login" Add-On.