Re: [Condor-users] how to submit this kind of job?

[Jeff Zhao <xiaoxiongg@xxxxxxxxx>]

the command isn't executed

1. wget http://192.168.10.63:8080/solr/core2/dataimport?command=full-import
   
2. --2011-11-30 10:44:42--  http://192.168.10.63:8080/solr/core2/dataimport?command=full-import
   
3. Connecting to 192.168.10.63:8080... connected.
   
4. HTTP request sent, awaiting response... 200 OK
   
5. Length: unspecified [application/xml]
   
6. Saving to: `dataimport?command=full-import.3'
   
7. 
   
8.     [ <=>                                                                                   ] 822         --.-K/s   in 0s      
   
9. 
   
10. 2011-11-30 10:44:42 (94.3 MB/s) - `dataimport?command=full-import.3' saved [822]
    
11. jeff@TILSI-Database:~$ more dataimport\?command\=full-import 
    
12. <?xml version="1.0" encoding="UTF-8"?>
    
13. <response>
    
14. <lst name="responseHeader">
    
15. <int name="status">0</int><int name="QTime">0</int></lst><lst name="initArgs">
    
16. <lst name="defaults">
    
17. <str name="config">/home/tyler/solr/core2/db/db-data-config.xml</str></lst></lst>
    
18. <str name="command">full-import</str>
    
19. <str name="status">idle</str>
    
20. <str name="importResponse"/><lst name="statusMessages">
    
21. <str name="Time Elapsed">113:39:11.561</str>
    
22. <str name="Total Requests made to DataSource">0</str>
    
23. <str name="Total Rows Fetched">222529903</str>
    
24. <str name="Total Documents Processed">222528969</str>
    
25. <str name="Total Documents Skipped">0</str>
    
26. <str name="Full Dump Started">2011-11-25 16:37:22</str>
    
27. <str name="">Indexing failed. Rolled back all changes.</str>
    
28. <str name="Rolledback">2011-11-28 04:24:16</str></lst>
    
29. <str name="WARNING">This response format is experimental.  It is likely to change in the future.</str>
    
30. </response>

2011/11/29 Jeff Zhao <xiaoxiongg@xxxxxxxxx>

that url link is just like a job command, like 'executable=  http://192.168.10.63:8080/solr/core2/dataimport?command=full-import '

Thanks,

Jeff

2011/11/22 Thomas Luff <Thomas.Luff@xxxxxxx>

Hi Jeff

I cannot see that site because it's internal to your network (i guess?). but if that url links to a job submit description then you can either write a script to download it and then run condor_submit <filename>.

Or you could use curl and pipe the output to to condor_submit as I previously said 'curl http://192.168.10.63:8080/solr/core2/dataimport?command=full-import | condor_submit'

If you need to transfer any files along with the job you can specify URL's to download them from.

transfer_input_files = http://www.full.url/path/to/filename

Note: this needs to be configured first. See section 3.13.3 in the manual -> http://research.cs.wisc.edu/condor/manual/v7.6/3_13Setting_Up.html#sec:URL-transfer

Hope that helps

Tom

-- IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium.  Thank you.

_______________________________________________
Condor-users mailing list
To unsubscribe, send a message to condor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/condor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/condor-users/