I think it can do the job but I don't know about Asterisk.
I use an atom 425 with 2GB of RAM (looks to be the same as 525 but with half cache), it runs:
number of users (family): ~10
- jail with postfix and postgrey
- jail with postfix, spam-assassin, courier-imap
- jail with apache /...