Make it possible to build curl for Windows CE using the CeGCC toolchain.
With both CMake and autotools, including tests and examples, also in CI.
The build configuration is the default one with Schannel enabled. No
3rd-party dependencies have been tested.
Also revive old code to make Schannel build with Windows CE, including
certificate verification.
Builds have been throughougly tested. But, I've made no functional tests
for this PR. Some parts (esp. file operations, like truncate and seek)
are stubbed out and likely broken as a result. Test servers build, but
they do not work on Windows CE. This patch substitutes `fstat()` calls
with `stat()`, which operate on filenames, not file handles. This may or
may not work and/or may not be secure.
About CeGCC: I used the latest available macOS binary build v0.59.1
r1397 from 2009, in native `mingw32ce` build mode. CeGCC is in effect
MinGW + GCC 4.4.0 + old/classic-mingw Windows headers. It targets
Windows CE v3.0 according to its `_WIN32_WCE` value. It means this PR
restores portions of old/classic-mingw support. It makes the Windows CE
codepath compatible with GCC 4.4.0. It also adds workaround for CMake,
which cannot identify and configure this toolchain out of the box.
Notes:
- CMake doesn't recognize CeGCC/mingw32ce, necessitating tricks as seen
with Amiga and MS-DOS.
- CMake doesn't set `MINGW` for mingw32ce. Set it and `MINGW32CE`
manually as a helper variable, in addition to `WINCE` which CMake sets
based on `CMAKE_SYSTEM_NAME`.
- CMake fails to create an implib for `libcurl.dll`, due to not
recognizing the platform as a Windowsy one. This patch adds the
necessary workaround to make it work.
- headers shipping with CeGCC miss some things curl needs for Schannel
support. Fixed by restoring and renovating code previously deleted
old-mingw code.
- it's sometime non-trivial to figure out if a fallout is WinCE,
mingw32ce, old-mingw, or GCC version-specific.
- WinCE is always Unicode. With exceptions: no `wmain`,
`GetProcAddress()`.
- `_fileno()` is said to convert from `FILE *` to `void *` which is
a Win32 file `HANDLE`. (This patch doesn't use this, but with further
effort it probably could be.)
https://stackoverflow.com/questions/3989545/how-do-i-get-the-file-handle-from-the-fopen-file-structure
- WinCE has no signals, current directory, stdio/CRT file handles, no
`_get_osfhandle()`, no `errno`, no `errno.h`. Some of this stuff is
standard C89, yet missing from this platform. Microsoft expects
Windows CE apps to use Win32 file API and `FILE *` exclusively.
- revived CeGCC here (not tested for this PR):
https://building.enlyze.com/posts/a-new-windows-ce-x86-compiler-in-2024/
On `UNDER_CE` vs. `_WIN32_WCE`: (This patch settled on `UNDER_CE`)
- A custom VS2008 WinCE toolchain does not set any of these.
The compiler binaries don't contain these strings, and has no compiler
option for targeting WinCE, hinting that a vanilla toolchain isn't
setting any of them either.
- `UNDER_CE` is automatically defined by the CeGCC compiler.
https://cegcc.sourceforge.net/docs/details.html
- `UNDER_CE` is similar to `_WIN32`, except it's not set automatically
by all compilers. It's not supposed to have any value, like a version.
(Though e.g. OpenSSL sets it to a version)
- `_WIN32_WCE` is the CE counterpart of the non-CE `_WIN32_WINNT` macro.
That does return the targeted Windows CE version.
- `_WIN32_WCE` is not defined by compilers, and relies on a header
setting it to a default, or the build to set it to the desired target
version. This is also how `_WIN32_WINNT` works.
- `_WIN32_WCE` default is set by `windef.h` in CeGCC.
- `_WIN32_WCE` isn't set to a default by MSVC Windows CE headers (the
ones I checked at least).
- CMake sets `_WIN32_WCE=<ver>`, `UNDER_CE`, `WINCE` for MSVC WinCE.
- `_WIN32_WCE` seems more popular in other projects, including CeGCC
itself. `zlib` is a notable exception amongst curl dependencies,
which uses `UNDER_CE`.
- Since `_WIN32_WCE` needs "certain" headers to have it defined, it's
undefined depending on headers included beforehand.
- `curl/curl.h` re-uses `_WIN32_WCE`'s as a self-guard, relying on
its not-(necessarily)-defined-by-default property:
25b445e479/include/curl/curl.h (L77)
Toolchain downloads:
- Windows:
https://downloads.sourceforge.net/cegcc/cegcc/0.59.1/cegcc_mingw32ce_cygwin1.7_r1399.tar.bz2
- macOS Intel:
https://downloads.sourceforge.net/cegcc/cegcc/0.59.1/cegcc_mingw32ce_snowleopard_r1397.tar.bz2
Closes #15975
369 lines
9.3 KiB
C
369 lines
9.3 KiB
C
/***************************************************************************
|
|
* _ _ ____ _
|
|
* Project ___| | | | _ \| |
|
|
* / __| | | | |_) | |
|
|
* | (__| |_| | _ <| |___
|
|
* \___|\___/|_| \_\_____|
|
|
*
|
|
* Copyright (C) Daniel Stenberg, <daniel@haxx.se>, et al.
|
|
*
|
|
* This software is licensed as described in the file COPYING, which
|
|
* you should have received as part of this distribution. The terms
|
|
* are also available at https://curl.se/docs/copyright.html.
|
|
*
|
|
* You may opt to use, copy, modify, merge, publish, distribute and/or sell
|
|
* copies of the Software, and permit persons to whom the Software is
|
|
* furnished to do so, under the terms of the COPYING file.
|
|
*
|
|
* This software is distributed on an "AS IS" basis, WITHOUT WARRANTY OF ANY
|
|
* KIND, either express or implied.
|
|
*
|
|
* SPDX-License-Identifier: curl
|
|
*
|
|
***************************************************************************/
|
|
#include "test.h"
|
|
|
|
#include <fcntl.h>
|
|
|
|
#include "testutil.h"
|
|
#include "warnless.h"
|
|
#include "memdebug.h"
|
|
|
|
#define TEST_HANG_TIMEOUT 60 * 1000
|
|
|
|
struct Sockets {
|
|
curl_socket_t *sockets;
|
|
int count; /* number of sockets actually stored in array */
|
|
int max_count; /* max number of sockets that fit in allocated array */
|
|
};
|
|
|
|
struct ReadWriteSockets {
|
|
struct Sockets read, write;
|
|
};
|
|
|
|
/**
|
|
* Remove a file descriptor from a sockets array.
|
|
*/
|
|
static void removeFd(struct Sockets *sockets, curl_socket_t fd, int mention)
|
|
{
|
|
int i;
|
|
|
|
if(mention)
|
|
fprintf(stderr, "Remove socket fd %d\n", (int) fd);
|
|
|
|
for(i = 0; i < sockets->count; ++i) {
|
|
if(sockets->sockets[i] == fd) {
|
|
if(i < sockets->count - 1)
|
|
memmove(&sockets->sockets[i], &sockets->sockets[i + 1],
|
|
sizeof(curl_socket_t) * (sockets->count - (i + 1)));
|
|
--sockets->count;
|
|
}
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Add a file descriptor to a sockets array.
|
|
*/
|
|
static void addFd(struct Sockets *sockets, curl_socket_t fd, const char *what)
|
|
{
|
|
/**
|
|
* To ensure we only have each file descriptor once, we remove it then add
|
|
* it again.
|
|
*/
|
|
fprintf(stderr, "Add socket fd %d for %s\n", (int) fd, what);
|
|
removeFd(sockets, fd, 0);
|
|
/*
|
|
* Allocate array storage when required.
|
|
*/
|
|
if(!sockets->sockets) {
|
|
sockets->sockets = malloc(sizeof(curl_socket_t) * 20U);
|
|
if(!sockets->sockets)
|
|
return;
|
|
sockets->max_count = 20;
|
|
}
|
|
else if(sockets->count >= sockets->max_count) {
|
|
/* this can't happen in normal cases */
|
|
fprintf(stderr, "too many file handles error\n");
|
|
exit(2);
|
|
}
|
|
/*
|
|
* Add file descriptor to array.
|
|
*/
|
|
sockets->sockets[sockets->count] = fd;
|
|
++sockets->count;
|
|
}
|
|
|
|
/**
|
|
* Callback invoked by curl to poll reading / writing of a socket.
|
|
*/
|
|
static int curlSocketCallback(CURL *easy, curl_socket_t s, int action,
|
|
void *userp, void *socketp)
|
|
{
|
|
struct ReadWriteSockets *sockets = userp;
|
|
|
|
(void)easy; /* unused */
|
|
(void)socketp; /* unused */
|
|
|
|
if(action == CURL_POLL_IN || action == CURL_POLL_INOUT)
|
|
addFd(&sockets->read, s, "read");
|
|
|
|
if(action == CURL_POLL_OUT || action == CURL_POLL_INOUT)
|
|
addFd(&sockets->write, s, "write");
|
|
|
|
if(action == CURL_POLL_REMOVE) {
|
|
removeFd(&sockets->read, s, 1);
|
|
removeFd(&sockets->write, s, 0);
|
|
}
|
|
|
|
return 0;
|
|
}
|
|
|
|
/**
|
|
* Callback invoked by curl to set a timeout.
|
|
*/
|
|
static int curlTimerCallback(CURLM *multi, long timeout_ms, void *userp)
|
|
{
|
|
struct timeval *timeout = userp;
|
|
|
|
(void)multi; /* unused */
|
|
if(timeout_ms != -1) {
|
|
*timeout = tutil_tvnow();
|
|
timeout->tv_usec += (int)timeout_ms * 1000;
|
|
}
|
|
else {
|
|
timeout->tv_sec = -1;
|
|
}
|
|
return 0;
|
|
}
|
|
|
|
/**
|
|
* Check for curl completion.
|
|
*/
|
|
static int checkForCompletion(CURLM *curl, int *success)
|
|
{
|
|
int result = 0;
|
|
*success = 0;
|
|
while(1) {
|
|
int numMessages;
|
|
CURLMsg *message = curl_multi_info_read(curl, &numMessages);
|
|
if(!message)
|
|
break;
|
|
if(message->msg == CURLMSG_DONE) {
|
|
result = 1;
|
|
if(message->data.result == CURLE_OK)
|
|
*success = 1;
|
|
else
|
|
*success = 0;
|
|
}
|
|
else {
|
|
fprintf(stderr, "Got an unexpected message from curl: %i\n",
|
|
(int)message->msg);
|
|
result = 1;
|
|
*success = 0;
|
|
}
|
|
}
|
|
return result;
|
|
}
|
|
|
|
static int getMicroSecondTimeout(struct timeval *timeout)
|
|
{
|
|
struct timeval now;
|
|
ssize_t result;
|
|
now = tutil_tvnow();
|
|
result = (ssize_t)((timeout->tv_sec - now.tv_sec) * 1000000 +
|
|
timeout->tv_usec - now.tv_usec);
|
|
if(result < 0)
|
|
result = 0;
|
|
|
|
return curlx_sztosi(result);
|
|
}
|
|
|
|
/**
|
|
* Update a fd_set with all of the sockets in use.
|
|
*/
|
|
static void updateFdSet(struct Sockets *sockets, fd_set* fdset,
|
|
curl_socket_t *maxFd)
|
|
{
|
|
int i;
|
|
for(i = 0; i < sockets->count; ++i) {
|
|
#if defined(__DJGPP__)
|
|
#pragma GCC diagnostic push
|
|
#pragma GCC diagnostic ignored "-Warith-conversion"
|
|
#endif
|
|
FD_SET(sockets->sockets[i], fdset);
|
|
#if defined(__DJGPP__)
|
|
#pragma GCC diagnostic pop
|
|
#endif
|
|
if(*maxFd < sockets->sockets[i] + 1) {
|
|
*maxFd = sockets->sockets[i] + 1;
|
|
}
|
|
}
|
|
}
|
|
|
|
static void notifyCurl(CURLM *curl, curl_socket_t s, int evBitmask,
|
|
const char *info)
|
|
{
|
|
int numhandles = 0;
|
|
CURLMcode result = curl_multi_socket_action(curl, s, evBitmask, &numhandles);
|
|
if(result != CURLM_OK) {
|
|
fprintf(stderr, "Curl error on %s: %i (%s)\n",
|
|
info, result, curl_multi_strerror(result));
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Invoke curl when a file descriptor is set.
|
|
*/
|
|
static void checkFdSet(CURLM *curl, struct Sockets *sockets, fd_set *fdset,
|
|
int evBitmask, const char *name)
|
|
{
|
|
int i;
|
|
for(i = 0; i < sockets->count; ++i) {
|
|
if(FD_ISSET(sockets->sockets[i], fdset)) {
|
|
notifyCurl(curl, sockets->sockets[i], evBitmask, name);
|
|
}
|
|
}
|
|
}
|
|
|
|
CURLcode test(char *URL)
|
|
{
|
|
CURLcode res = CURLE_OK;
|
|
CURL *curl = NULL;
|
|
FILE *hd_src = NULL;
|
|
int hd;
|
|
struct_stat file_info;
|
|
CURLM *m = NULL;
|
|
struct ReadWriteSockets sockets = {{NULL, 0, 0}, {NULL, 0, 0}};
|
|
int success = 0;
|
|
struct timeval timeout = {0};
|
|
timeout.tv_sec = (time_t)-1;
|
|
|
|
assert(test_argc >= 5);
|
|
|
|
start_test_timing();
|
|
|
|
if(!libtest_arg3) {
|
|
fprintf(stderr, "Usage: lib582 [url] [filename] [username]\n");
|
|
return TEST_ERR_USAGE;
|
|
}
|
|
|
|
hd_src = fopen(libtest_arg2, "rb");
|
|
if(!hd_src) {
|
|
fprintf(stderr, "fopen() failed with error: %d (%s)\n",
|
|
errno, strerror(errno));
|
|
fprintf(stderr, "Error opening file: (%s)\n", libtest_arg2);
|
|
return TEST_ERR_FOPEN;
|
|
}
|
|
|
|
/* get the file size of the local file */
|
|
#ifdef UNDER_CE
|
|
hd = stat(libtest_arg2, &file_info);
|
|
#else
|
|
hd = fstat(fileno(hd_src), &file_info);
|
|
#endif
|
|
if(hd == -1) {
|
|
/* can't open file, bail out */
|
|
fprintf(stderr, "fstat() failed with error: %d (%s)\n",
|
|
errno, strerror(errno));
|
|
fprintf(stderr, "ERROR: cannot open file (%s)\n", libtest_arg2);
|
|
fclose(hd_src);
|
|
return TEST_ERR_FSTAT;
|
|
}
|
|
fprintf(stderr, "Set to upload %d bytes\n", (int)file_info.st_size);
|
|
|
|
res_global_init(CURL_GLOBAL_ALL);
|
|
if(res) {
|
|
fclose(hd_src);
|
|
return res;
|
|
}
|
|
|
|
easy_init(curl);
|
|
|
|
/* enable uploading */
|
|
easy_setopt(curl, CURLOPT_UPLOAD, 1L);
|
|
|
|
/* specify target */
|
|
easy_setopt(curl, CURLOPT_URL, URL);
|
|
|
|
/* go verbose */
|
|
easy_setopt(curl, CURLOPT_VERBOSE, 1L);
|
|
|
|
/* now specify which file to upload */
|
|
easy_setopt(curl, CURLOPT_READDATA, hd_src);
|
|
|
|
easy_setopt(curl, CURLOPT_USERPWD, libtest_arg3);
|
|
easy_setopt(curl, CURLOPT_SSH_PUBLIC_KEYFILE, test_argv[4]);
|
|
easy_setopt(curl, CURLOPT_SSH_PRIVATE_KEYFILE, test_argv[5]);
|
|
easy_setopt(curl, CURLOPT_SSL_VERIFYHOST, 0L);
|
|
|
|
easy_setopt(curl, CURLOPT_INFILESIZE_LARGE, (curl_off_t)file_info.st_size);
|
|
|
|
multi_init(m);
|
|
|
|
multi_setopt(m, CURLMOPT_SOCKETFUNCTION, curlSocketCallback);
|
|
multi_setopt(m, CURLMOPT_SOCKETDATA, &sockets);
|
|
|
|
multi_setopt(m, CURLMOPT_TIMERFUNCTION, curlTimerCallback);
|
|
multi_setopt(m, CURLMOPT_TIMERDATA, &timeout);
|
|
|
|
multi_add_handle(m, curl);
|
|
|
|
while(!checkForCompletion(m, &success)) {
|
|
fd_set readSet, writeSet;
|
|
curl_socket_t maxFd = 0;
|
|
struct timeval tv = {0};
|
|
tv.tv_sec = 10;
|
|
|
|
FD_ZERO(&readSet);
|
|
FD_ZERO(&writeSet);
|
|
updateFdSet(&sockets.read, &readSet, &maxFd);
|
|
updateFdSet(&sockets.write, &writeSet, &maxFd);
|
|
|
|
if(timeout.tv_sec != (time_t)-1) {
|
|
int usTimeout = getMicroSecondTimeout(&timeout);
|
|
tv.tv_sec = usTimeout / 1000000;
|
|
tv.tv_usec = usTimeout % 1000000;
|
|
}
|
|
else if(maxFd <= 0) {
|
|
tv.tv_sec = 0;
|
|
tv.tv_usec = 100000;
|
|
}
|
|
|
|
select_test((int)maxFd, &readSet, &writeSet, NULL, &tv);
|
|
|
|
/* Check the sockets for reading / writing */
|
|
checkFdSet(m, &sockets.read, &readSet, CURL_CSELECT_IN, "read");
|
|
checkFdSet(m, &sockets.write, &writeSet, CURL_CSELECT_OUT, "write");
|
|
|
|
if(timeout.tv_sec != (time_t)-1 && getMicroSecondTimeout(&timeout) == 0) {
|
|
/* Curl's timer has elapsed. */
|
|
notifyCurl(m, CURL_SOCKET_TIMEOUT, 0, "timeout");
|
|
}
|
|
|
|
abort_on_test_timeout();
|
|
}
|
|
|
|
if(!success) {
|
|
fprintf(stderr, "Error uploading file.\n");
|
|
res = TEST_ERR_MAJOR_BAD;
|
|
}
|
|
|
|
test_cleanup:
|
|
|
|
/* proper cleanup sequence - type PB */
|
|
|
|
curl_multi_remove_handle(m, curl);
|
|
curl_easy_cleanup(curl);
|
|
curl_multi_cleanup(m);
|
|
curl_global_cleanup();
|
|
|
|
/* close the local file */
|
|
fclose(hd_src);
|
|
|
|
/* free local memory */
|
|
free(sockets.read.sockets);
|
|
free(sockets.write.sockets);
|
|
|
|
return res;
|
|
}
|