TortoiseSVN uses Subversion. And Subversion supports SSH svn+ssh:// (repository reachable via svnserve). If you don't want to use the svnserve server but Apache instead (which we would recommend!) then Subversion supports secure connections via SSL.
A guide on how to secure your Apache server with SSL can be found in the TortoiseSVN Daily Use Guide
Please have a look at the subversion book and the INSTALL file of subversion on how to use svn+ssh://