Thousands of criminals who commit minor offences could escape prosecution if the court cases are thought to be too costly or too complex under new guidance to prosecutors.