New Module: Curl Module (now with multi language support)

[moulin]

Curl Module
I made a small curl module for websitebaker. It is an initial release and some more options will be added.

What is Curl:
This Curl module almost works like a wrapper page. Instead of loading a full external page you can only show a selection with Curl. For example if you want to copy (with permission) the event agenda of your sports club which is on the homepage you can show the agenda and not all the text around it. Just specify the page where you want your get your information from. Look in the html file where the part starts that you need. Fill this in for the start and end. Voila (Frech for wow that is easy), the snippit will appear on your websitebaker page.

How to use:

• Install module 
• Make a Curl page

example:

• Add the desired website. eg.
  http://www.websitebaker.org/2/about/
  
• Add tag where you want to start. eg.
  <h1>About</h1>
  
• Add tag where you want to end. eg.
  downloads page</a>.
• Test to see if the page works

Need to know:
At the moment it is not possible to parse relative links. This can be a problem with the css style and images. I am working on it

Warning: Stealing is NEVER a good idea. Make sure you are allowed to use a snippit of a page. Sometimes there is copyright on the material.

Languages supported:

• English
• Dutch
• German (by Matthias)

To do:

• Making it possible to parse $_POST
• Source field
• Multi language support
• Cleaning up code and better design modify page
• Rewrite relative links from source link
• Access to remote site with username/password

Changelog: (Thank you Matthias)

• Replaced all variables $module_directory with hardcoded curl to prevent install errors
• Made install script mysql5 strict mode compatible
• Layout changes in the modify window
• If curl is not loaded only a warning is displayed in modify window
• Changed language file inclusion
• Added german language file
• Made the link of the wrapped page in view.php clickable
• Code sorting and a few minor fixes in all files
• Replaced all copyright notices

Update:
April 23 2006: Version .03 released.
April 23 2006: Version .04 released.
April 24 2006: Version .05 released.
April 25 2006: Version .06 released.
April 25 2006: Version .07 released. Thank you Pcwacht!
October 22 2006: Version .08 released. Thank you Matthias!

If you have any suggestions please let me know. If you translated the text file in /languages/ please send it to me so I can include it.

Marco de Moulin

[valerie]

Can you help me understand what this does differently from the wrapper?

[moulin]

With a wrapper you get the full html page from another site. With Curl you can get a part of that page. For example if you want to have the weather forecast from a site you might only want to have 'today's weather' intead of everything. With Curl this is very easy.

[kickarse]

Very cool this will be handy!

[kweitzel]

Hey ... post that one to "ruebenwurzel" and "woudloper" for testing. Then it can go to the add on repository ...

cheers

Klaus

[moulin]

@Kweitzel:
Yes I will do that when I am fully satisfied with the script. I think I can still make some changes and additions.

[Woudloper]

Interesting module. Saw that you've made a mistake in the 'install.php'. The query body is wrong! I see a reference to galtitle, but this isn't in your table. This mistake results in an error when searching the website.

[moulin]

@Woudloper:
Yep I must have missed that one. I did not try out the search function yet. So thanks!

[moulin]

Is there anyone who knows how to include a remote css file? How should this be linked to the main css file of website baker?

Marco

[kweitzel]

maybe better start a new topic for that ...

cheers

Klaus

[virgil]

@Klaus

y're right...


@Marco

see answer in new topic...

http://forum.websitebaker.org/index.php/topic,3143.0.html

Cheers
Virgil

[moulin]

I am updating the script. Are there still special needs? Still looking for translaters. Send me a pm.

[ruebenwurzel]

Hello,

This modul is based on the simple modul. The simple modul works with including info.php and the variable $module_directory. During install process this variable couldn't be used in some cases. So if you update the script replace this variable with the hardcoded moduldirectory to prevent this nstall issues.

Thanks

Matthias

[diskostu]

so if on php server by my host curl is not loaded i can't use this module right?

there's a way to do exactly what your module does without needing curl loaded?
thanks

[ruebenwurzel]

Hello,

@diskostu

so if on php server by my host curl is not loaded i can't use this module right?

right

there's a way to do exactly what your module does without needing curl loaded?

no

@all
Attached you find a bugfixed version 0.8 of this modul:

Changelog:
- replaced all variables $module_directory with hardcoded curl to prevent install errors
- made install script mysql5 strict mode compatible
- layout changes in the modify window
- if curl is not loaded only a warning is displayed in modify window
- changed language file inclusion
- added german language file
- made the link of the wrapped page in view.php clickable
- code sorting and a few minor fixes in all files
- replaced all copyright notices

Hope you like it

Matthias

[kozmoz]

When start tag is empty, I get a PHP waring:


Warning: strpos(): Empty delimiter. in /var/www/wb3/modules/curl/view.php on line 71

[ruebenwurzel]

Hello,

This modul only works when a start and a end tag is defined. If one fails it is correct that a error message is displayed.

Matthias

[clubvibe]

I'm trying to use Curl module but it keeps saying .. "Couldn't connect to http://www.xxxx.xxx" no matter what url i use. I checked if Curl is supported in phpinfo and it is. Anyone an idea howcome it doens't work?

I tried to use it with wb 2.6.3 and a beta of 2.6.6. (also inline wrapper module isn't working)

[moulin]

I'm trying to use Curl module but it keeps saying .. "Couldn't connect to http://www.xxxx.xxx" no matter what url i use. I checked if Curl is supported in phpinfo and it is. Anyone an idea howcome it doens't work?

Perhaps your host does not support outgoing Internet traffic from their local host. What version of PHP do you use? And do you run Apache?

I tried to use it with wb 2.6.3 and a beta of 2.6.6. (also inline wrapper module isn't working)

The inline wrapper should download the page in your browser and not on the server side. Do you have more problems with other modules?

[clubvibe]

Other modules work just fine. You can find my phpinfo here

I can't understand why both modules won't work. I get an error: (3) in using inline wrapper

edit: i tried an other server (PHPinfo) and everything just worked fine! the thing is i don't understand why it doesn't work on this server.

Want do i (well..my webhoster i mean) have to change in the php config doe i have to change to get it working?