Sep 17 07:14:45 devstack cinder-volume[75404]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 17 07:14:45 devstack cinder-volume[75404]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 17 07:14:45 devstack cinder-volume[75404]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 17 07:14:47 devstack cinder-volume[75404]: INFO dbcounter [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Registered counter for database cinder Sep 17 07:14:47 devstack cinder-volume[75404]: DEBUG oslo_db.sqlalchemy.engines [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 07:14:47 devstack cinder-volume[75404]: DEBUG dbcounter [-] [75404] Writer thread running {{(pid=75404) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 17 07:14:47 devstack cinder-volume[75404]: INFO cinder.rpc [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 07:14:47 devstack cinder-volume[75404]: INFO cinder.rpc [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 07:14:47 devstack cinder-volume[75404]: DEBUG oslo_db.sqlalchemy.engines [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 07:14:48 devstack cinder-volume[75404]: INFO cinder.volume.manager [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Determined volume DB was empty at startup. Sep 17 07:14:48 devstack cinder-volume[75404]: DEBUG cinder.volume.manager [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75404) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 17 07:14:48 devstack cinder-volume[75404]: INFO cinder.volume.manager [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 07:14:48 devstack cinder-volume[75404]: WARNING stevedore.named [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 07:14:48 devstack cinder-volume[75404]: WARNING castellan.key_manager [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 07:14:48 devstack cinder-volume[75404]: WARNING cinder.keymgr.conf_key_mgr [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 07:14:48 devstack cinder-volume[75404]: DEBUG cinder.volume.drivers.lvm [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75404) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 17 07:14:48 devstack cinder-volume[75404]: DEBUG oslo_concurrency.processutils [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75404) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:14:49 devstack cinder-volume[75404]: DEBUG oslo_concurrency.processutils [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] CMD "cinder-rtstool verify" returned: 0 in 1.090s {{(pid=75404) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:14:49 devstack cinder-volume[75404]: DEBUG oslo_db.sqlalchemy.engines [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 07:14:49 devstack cinder-volume[75404]: INFO cinder.rpc [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 17 07:14:49 devstack cinder-volume[75404]: INFO cinder.rpc [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 17 07:14:49 devstack cinder-volume[75404]: WARNING stevedore.named [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 07:14:49 devstack cinder-volume[75404]: WARNING castellan.key_manager [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 07:14:49 devstack cinder-volume[75404]: INFO cinder.volume.manager [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 17 07:14:49 devstack cinder-volume[75404]: DEBUG oslo_db.sqlalchemy.engines [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 07:14:50 devstack cinder-volume[75404]: INFO oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Starting 1 workers Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Started child 75526 {{(pid=75404) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Full set of CONF: {{(pid=75404) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] ******************************************************************************** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Configuration options gathered from: {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] ================================================================================ {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] allow_availability_zone_fallback = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] allow_compression_on_image_upload = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] allowed_direct_url_schemes = [] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] api_rate_limit = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] auth_strategy = keystone {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] az_cache_duration = 3600 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75526]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.1) Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_availability_zone = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_host = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_name = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_stats_polling_interval = 60 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backup_api_class = cinder.backup.api.API {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backup_name_template = backup-%s {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backup_use_same_host = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backup_use_temp_snapshot = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] chap_password = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] chap_username = {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cinder_internal_tenant_project_id = f1935ed7e6e946d09ef9534b324cb3ef {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cinder_internal_tenant_user_id = a7129fba7e92404cb21f24749bb504ab {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cloned_volume_same_az = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cluster = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] compression_format = gzip {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] compute_api_class = cinder.compute.nova.API {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] config_dir = [] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] config_source = [] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] control_exchange = openstack {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] debug = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] default_availability_zone = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] default_group_type = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] default_volume_type = lvmdriver-1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] driver_client_cert = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] driver_client_cert_key = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] driver_data_namespace = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] driver_ssl_cert_path = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] driver_ssl_cert_verify = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] driver_use_ssl = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] enable_force_upload = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] enable_new_services = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] enable_unsupported_driver = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] enabled_backends = ['lvmdriver-1'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] enforce_multipath_for_image_xfer = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] filter_function = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] glance_api_insecure = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] glance_api_servers = ['http://192.168.122.170/image'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] glance_api_ssl_compression = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] glance_ca_certificates_file = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] glance_catalog_info = image:glance:publicURL {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] glance_certfile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] glance_keyfile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] glance_num_retries = 3 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] glance_request_timeout = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] goodness_function = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] graceful_shutdown_timeout = 5 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] group_api_class = cinder.group.api.API {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] host = devstack {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] image_compress_on_upload = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] image_conversion_address_space_limit = 1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] image_conversion_cpu_limit = 60 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] image_conversion_disable = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] image_upload_use_cinder_backend = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] image_upload_use_internal_tenant = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] image_volume_cache_enabled = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] image_volume_cache_max_count = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] image_volume_cache_max_size_gb = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] init_host_max_objects_retrieval = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] instance_format = [instance: %(uuid)s] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] iscsi_iotype = fileio {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] iscsi_target_flags = {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] iscsi_write_cache = on {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] iser_helper = tgtadm {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] iser_ip_address = 192.168.122.170 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] iser_port = 3260 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] log_color = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] log_config_append = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] log_dir = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] log_file = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] log_options = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] log_rotate_interval = 1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] log_rotate_interval_type = days {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] log_rotation_type = none {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] max_age = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] max_logfile_count = 30 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] max_logfile_size_mb = 200 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] max_over_subscription_ratio = 20.0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] message_reap_interval = 86400 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] message_ttl = 2592000 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] migration_create_volume_timeout_secs = 300 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] monkey_patch = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] monkey_patch_modules = [] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] my_ip = 192.168.122.170 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] no_snapshot_gb_quota = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] num_iser_scan_tries = 3 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] num_shell_tries = 3 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] num_volume_device_scan_tries = 3 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] nvmeof_conn_info_version = 1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] nvmet_ns_id = 10 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] nvmet_port_id = 1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] osapi_max_limit = 1000 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] osapi_volume_ext_list = [] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] osapi_volume_listen = 0.0.0.0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] osapi_volume_listen_port = 8776 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] osapi_volume_use_ssl = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] osapi_volume_workers = 2 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] per_volume_size_limit = -1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] periodic_fuzzy_delay = 60 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] periodic_interval = 60 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] project_id_regex = [0-9a-f\-]+ {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] public_endpoint = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] publish_errors = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] quota_backup_gigabytes = 1000 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] quota_backups = 10 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] quota_gigabytes = 1000 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] quota_groups = 10 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] quota_snapshots = 10 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] quota_volumes = 10 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] rate_limit_burst = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] rate_limit_except_level = CRITICAL {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] rate_limit_interval = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] reinit_driver_count = 3 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] replication_device = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] report_discard_supported = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] report_interval = 120 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] reservation_clean_interval = 86400 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] reservation_expire = 86400 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] reserved_image_namespaces = [] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] reserved_percentage = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] rpc_response_timeout = 120 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] run_external_periodic_tasks = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] scst_target_driver = iscsi {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] scst_target_iqn_name = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] service_down_time = 720 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] shell_completion = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] snapshot_name_template = snapshot-%s {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] snapshot_same_host = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] split_loggers = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] state_path = /opt/stack/data/cinder {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] storage_availability_zone = nova {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] storage_protocol = iSCSI {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] syslog_log_facility = LOG_USER {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] target_helper = lioadm {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] target_ip_address = 192.168.122.170 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] target_port = 3260 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] target_protocol = iscsi {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] target_secondary_ip_addresses = [] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] trace_flags = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] transfer_api_class = cinder.transfer.api.API {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] transport_url = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] until_refresh = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] use_chap_auth = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] use_default_quota_class = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] use_journal = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] use_json = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] use_multipath_for_image_xfer = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] use_stderr = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] use_syslog = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] verify_glance_signatures = enabled {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] volume_api_class = cinder.volume.api.API {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] volume_backend_name = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] volume_clear = zero {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] volume_clear_ionice = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] volume_clear_size = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] volume_copy_bps_limit = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] volume_dd_blocksize = 1M {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] volume_name_template = volume-%s {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] volume_service_inithost_offload = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] volume_usage_audit_period = month {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] watch_log_file = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] zoning_mode = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_concurrency.disable_process_locking = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.admin_password = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.admin_token = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.admin_user = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.auth_admin_prefix = {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.auth_port = 35357 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.auth_protocol = https {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.auth_section = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.auth_type = password {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.auth_uri = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.auth_version = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.cache = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.certfile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.delay_auth_decision = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.http_connect_timeout = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.identity_uri = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.include_service_catalog = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.insecure = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.interface = public {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.keyfile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_password = {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcache_username = {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.region_name = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.service_token_roles_required = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.service_type = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.token_cache_time = 300 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.backend = dogpile.cache.null {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.backend_argument = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.backend_expiration_time = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.config_prefix = cache.oslo {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.dead_timeout = 60.0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.debug_cache_backend = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.enable_retry_client = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.enable_socket_keepalive = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.enabled = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.enforce_fips_mode = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.expiration_time = 600 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.hashclient_retry_attempts = 2 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.hashclient_retry_delay = 1.0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.memcache_dead_retry = 300 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.memcache_password = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.memcache_pool_maxsize = 10 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.memcache_sasl_enabled = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.memcache_socket_timeout = 1.0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.memcache_username = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.proxies = [] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.redis_db = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.redis_password = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.redis_sentinel_service_name = mymaster {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.redis_server = localhost:6379 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.redis_socket_timeout = 1.0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.redis_username = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.retry_attempts = 2 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.retry_delay = 0.0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.socket_keepalive_count = 1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.socket_keepalive_idle = 1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.socket_keepalive_interval = 1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.tls_allowed_ciphers = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.tls_cafile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.tls_certfile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.tls_enabled = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cache.tls_keyfile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] coordination.backend_url = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.asyncio_connection = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.asyncio_slave_connection = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.backend = sqlalchemy {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.connection = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.connection_debug = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.connection_parameters = {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.connection_recycle_time = 3600 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.connection_trace = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.db_inc_retry_interval = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.db_max_retries = 20 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.db_max_retry_interval = 10 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.db_retry_interval = 1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.max_overflow = 50 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.max_pool_size = 5 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.max_retries = 10 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.mysql_wsrep_sync_wait = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.pool_timeout = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.retry_interval = 10 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.slave_connection = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.sqlite_synchronous = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] database.use_db_reconnect = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] profiler.connection_string = messaging:// {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] profiler.enabled = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] profiler.es_doc_type = notification {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] profiler.es_scroll_size = 10000 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] profiler.es_scroll_time = 2m {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] profiler.filter_error_trace = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] profiler.hmac_keys = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] profiler.sentinel_service_name = mymaster {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] profiler.socket_timeout = 0.1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] profiler.trace_requests = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] profiler.trace_sqlalchemy = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] profiler_jaeger.process_tags = {} {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] profiler_jaeger.service_name_prefix = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] profiler_otlp.service_name_prefix = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_policy.enforce_new_defaults = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75526]: INFO cinder.volume.manager [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 17 07:14:50 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:14:50 devstack cinder-volume[75404]: WARNING oslo_config.cfg [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_policy.enforce_scope = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_policy.policy_default_rule = default {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_policy.policy_file = policy.yaml {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_policy.remote_timeout = 60.0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] privsep_osbrick.group = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] privsep_osbrick.helper_command = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] privsep_osbrick.user = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cinder_sys_admin.group = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cinder_sys_admin.helper_command = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] cinder_sys_admin.user = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] service_user.auth_section = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] service_user.auth_type = password {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] service_user.certfile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] service_user.collect_timing = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] service_user.insecure = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] service_user.keyfile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] service_user.send_service_user_token = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] service_user.split_loggers = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] service_user.timeout = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.backend_availability_zone = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.chap_password = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.chap_username = {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.driver_client_cert = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.driver_client_cert_key = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.driver_data_namespace = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.driver_use_ssl = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.enable_unsupported_driver = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.extra_capabilities = {} {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.filter_function = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.goodness_function = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.iscsi_iotype = fileio {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.iscsi_target_flags = {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.iscsi_write_cache = on {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.iser_helper = tgtadm {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.iser_ip_address = 192.168.122.170 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.iser_port = 3260 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.lvm_mirrors = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.lvm_share_target = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.lvm_type = auto {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.num_shell_tries = 3 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.nvmet_port_id = 1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.replication_device = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.report_discard_supported = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.reserved_percentage = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.scst_target_driver = iscsi {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.scst_target_iqn_name = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.storage_protocol = iSCSI {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.target_helper = tgtadm {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.target_ip_address = 192.168.122.170 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.target_port = 3260 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.target_protocol = iscsi {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.trace_flags = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.unique_fqdn_network = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.use_chap_auth = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.volume_backend_name = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.volume_clear = zero {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.volume_clear_ionice = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.volume_clear_size = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.volume_group = cinder-volumes {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_reports.file_event_handler = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_reports.log_dir = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.backend_availability_zone = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.backend_host = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.chap_password = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.chap_username = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.chiscsi_conf = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.driver_client_cert = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.driver_data_namespace = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.driver_use_ssl = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.extra_capabilities = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.filter_function = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.goodness_function = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.iscsi_iotype = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.iser_helper = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.iser_ip_address = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.iser_port = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.iser_target_prefix = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.lvm_conf_file = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.lvm_mirrors = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.lvm_share_target = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.lvm_type = auto {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.num_shell_tries = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.nvmet_port_id = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.replication_device = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.report_discard_supported = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.reserved_percentage = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.scst_target_driver = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.storage_protocol = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.target_helper = lioadm {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.target_ip_address = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.target_port = 3260 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.target_protocol = iscsi {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.trace_flags = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.use_chap_auth = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.volume_clear = zero {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.volume_clear_size = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] lvmdriver-1.volumes_dir = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.199s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.ssl = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.ssl_version = {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_notifications.driver = [] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_notifications.retry = -1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] oslo_messaging_notifications.transport_url = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] key_manager.fixed_key = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.barbican_api_version = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.barbican_endpoint = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.barbican_endpoint_type = public {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.barbican_region_name = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.cafile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.certfile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.collect_timing = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.insecure = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.keyfile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.number_of_retries = 60 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.retry_delay = 1 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.send_service_user_token = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.split_loggers = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.timeout = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.verify_ssl = True {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican.verify_ssl_path = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican_service_user.auth_section = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican_service_user.auth_type = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican_service_user.cafile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican_service_user.certfile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican_service_user.collect_timing = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican_service_user.insecure = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican_service_user.keyfile = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican_service_user.split_loggers = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] barbican_service_user.timeout = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] vault.approle_role_id = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] vault.approle_secret_id = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] vault.kv_mountpoint = secret {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] vault.kv_path = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] vault.kv_version = 2 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] vault.namespace = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] vault.root_token_id = **** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] vault.ssl_ca_crt_file = None {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] vault.timeout = 60.0 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] vault.use_ssl = False {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:14:50 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] ******************************************************************************** {{(pid=75404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 17 07:14:51 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:14:51 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.156s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:14:51 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:14:51 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.114s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:14:51 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:14:51 devstack sudo[75587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 17 07:14:51 devstack sudo[75587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:14:53 devstack sudo[75587]: pam_unix(sudo:session): session closed for user root Sep 17 07:14:53 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.225s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:14:53 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:14:53 devstack sudo[75722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:14:53 devstack sudo[75722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:14:55 devstack sudo[75722]: pam_unix(sudo:session): session closed for user root Sep 17 07:14:55 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.064s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:14:55 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:14:55 devstack cinder-volume[75526]: INFO cinder.brick.local_dev.lvm [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 17 07:14:55 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:14:55 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.077s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:14:55 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:14:55 devstack sudo[75819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:14:55 devstack sudo[75819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:14:57 devstack sudo[75819]: pam_unix(sudo:session): session closed for user root Sep 17 07:14:57 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.026s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:14:57 devstack cinder-volume[75526]: DEBUG cinder.brick.local_dev.lvm [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75526) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 17 07:14:57 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:14:57 devstack sudo[75906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:14:57 devstack sudo[75906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:14:59 devstack cinder-volume[75404]: DEBUG dbcounter [-] [75404] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75404) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:15:01 devstack sudo[75906]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:01 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.649s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:01 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:01 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.216s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:01 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:01 devstack sudo[76109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:15:01 devstack sudo[76109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:03 devstack sudo[76109]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:03 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.044s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:03 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:04 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.111s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:04 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:04 devstack sudo[76146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 17 07:15:04 devstack sudo[76146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:06 devstack sudo[76146]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:06 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.228s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:06 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:06 devstack sudo[76179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:15:06 devstack sudo[76179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:09 devstack sudo[76179]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:09 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.849s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:09 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:09 devstack sudo[76238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:15:09 devstack sudo[76238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:11 devstack sudo[76238]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:11 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.473s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:11 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:11 devstack sudo[76243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:15:11 devstack sudo[76243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:14 devstack sudo[76243]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:14 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 3.041s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:14 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:14 devstack sudo[76248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:15:14 devstack sudo[76248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:17 devstack sudo[76248]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:17 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.283s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:17 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:17 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.128s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:17 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:17 devstack sudo[76262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:15:17 devstack sudo[76262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:19 devstack sudo[76262]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:19 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.489s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:19 devstack cinder-volume[75526]: INFO cinder.volume.drivers.lvm [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 17 07:15:19 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:19 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.088s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:19 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:20 devstack sudo[76361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:15:20 devstack sudo[76361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:22 devstack sudo[76361]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:22 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.611s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:22 devstack cinder-volume[75526]: DEBUG cinder.volume.drivers.lvm [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Updating volume stats {{(pid=75526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 07:15:22 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:22 devstack sudo[76439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:15:22 devstack sudo[76439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:24 devstack sudo[76439]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:24 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.041s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:24 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:24 devstack sudo[76547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:15:24 devstack sudo[76547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:26 devstack sudo[76547]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:26 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.200s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:26 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:26 devstack sudo[76550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:15:26 devstack sudo[76550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:28 devstack sudo[76550]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:28 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.979s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:28 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:28 devstack sudo[76556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:15:28 devstack sudo[76556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:30 devstack sudo[76556]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:30 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.067s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:30 devstack cinder-volume[75526]: INFO cinder.volume.driver [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Driver hasn't implemented _init_vendor_properties() Sep 17 07:15:30 devstack cinder-volume[75526]: DEBUG cinder.volume.driver [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75526) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:844}} Sep 17 07:15:31 devstack cinder-volume[75526]: DEBUG oslo_db.sqlalchemy.engines [None req-12631a80-4976-4615-9982-479ef161a1bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75526) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 07:15:31 devstack cinder-volume[75526]: DEBUG dbcounter [-] [75526] Writer thread running {{(pid=75526) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 17 07:15:31 devstack cinder-volume[75526]: DEBUG cinder.db.sqlalchemy.api [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Building query based on filter {{(pid=75526) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 17 07:15:31 devstack cinder-volume[75526]: DEBUG cinder.image.image_utils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75526) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 17 07:15:31 devstack cinder-volume[75526]: INFO cinder.keymgr.migration [None req-6866e692-ae00-4781-8233-e119dc42016e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 07:15:31 devstack cinder-volume[75526]: DEBUG cinder.volume.drivers.lvm [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Updating volume stats {{(pid=75526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 07:15:31 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:31 devstack sudo[76567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:15:31 devstack sudo[76567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:33 devstack sudo[76567]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:33 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.950s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:33 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:33 devstack sudo[76571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:15:33 devstack sudo[76571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:35 devstack sudo[76571]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:35 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.271s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:35 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:35 devstack sudo[76687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:15:35 devstack sudo[76687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:38 devstack sudo[76687]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:38 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.374s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:38 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:38 devstack sudo[76718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:15:38 devstack sudo[76718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:40 devstack sudo[76718]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:40 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.008s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:40 devstack cinder-volume[75526]: DEBUG cinder.manager [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Notifying Schedulers of capabilities ... {{(pid=75526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:15:40 devstack cinder-volume[75526]: INFO cinder.volume.manager [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Driver initialization completed successfully. Sep 17 07:15:40 devstack cinder-volume[75526]: INFO cinder.manager [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Initiating service 2 cleanup Sep 17 07:15:40 devstack cinder-volume[75526]: INFO cinder.manager [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Service 2 cleanup completed. Sep 17 07:15:40 devstack cinder-volume[75526]: DEBUG cinder.service [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Creating RPC server for service cinder-volume {{(pid=75526) start /opt/stack/cinder/cinder/service.py:239}} Sep 17 07:15:40 devstack cinder-volume[75526]: DEBUG cinder.service [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75526) start /opt/stack/cinder/cinder/service.py:245}} Sep 17 07:15:40 devstack cinder-volume[75526]: INFO cinder.volume.manager [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 17 07:15:40 devstack cinder-volume[75526]: DEBUG cinder.volume.drivers.lvm [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Updating volume stats {{(pid=75526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 07:15:40 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:40 devstack sudo[76722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:15:40 devstack sudo[76722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:42 devstack sudo[76722]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:42 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.126s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:42 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:42 devstack sudo[76730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:15:42 devstack sudo[76730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:44 devstack sudo[76730]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:44 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.044s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:44 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:45 devstack sudo[76733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:15:45 devstack sudo[76733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:46 devstack sudo[76733]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:46 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.016s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:46 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:15:47 devstack sudo[76740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:15:47 devstack sudo[76740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:15:49 devstack sudo[76740]: pam_unix(sudo:session): session closed for user root Sep 17 07:15:49 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-12631a80-4976-4615-9982-479ef161a1bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.156s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:15:49 devstack cinder-volume[75526]: DEBUG dbcounter [-] [75526] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75526) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:15:49 devstack cinder-volume[75526]: INFO cinder.volume.manager [None req-12631a80-4976-4615-9982-479ef161a1bc None None] Driver post RPC initialization completed successfully. Sep 17 07:15:59 devstack cinder-volume[75526]: DEBUG dbcounter [-] [75526] Writing DB stats cinder:SELECT=3 {{(pid=75526) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:16:02 devstack cinder-volume[75526]: DEBUG oslo_service.periodic_task [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75526) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:16:02 devstack cinder-volume[75526]: DEBUG cinder.volume.drivers.lvm [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Updating volume stats {{(pid=75526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 07:16:02 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:16:02 devstack sudo[77038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:16:02 devstack sudo[77038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:16:04 devstack sudo[77038]: pam_unix(sudo:session): session closed for user root Sep 17 07:16:04 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.007s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:16:04 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:16:04 devstack sudo[77058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:16:04 devstack sudo[77058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:16:06 devstack sudo[77058]: pam_unix(sudo:session): session closed for user root Sep 17 07:16:06 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.014s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:16:06 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:16:06 devstack sudo[77163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:16:06 devstack sudo[77163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:16:08 devstack sudo[77163]: pam_unix(sudo:session): session closed for user root Sep 17 07:16:08 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.003s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:16:08 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:16:08 devstack sudo[77284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:16:08 devstack sudo[77284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:16:10 devstack sudo[77284]: pam_unix(sudo:session): session closed for user root Sep 17 07:16:10 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.771s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:16:10 devstack cinder-volume[75526]: DEBUG cinder.manager [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Notifying Schedulers of capabilities ... {{(pid=75526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:17:02 devstack cinder-volume[75526]: DEBUG oslo_service.periodic_task [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75526) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:17:02 devstack cinder-volume[75526]: DEBUG cinder.volume.drivers.lvm [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Updating volume stats {{(pid=75526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 07:17:02 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:17:02 devstack sudo[78129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:17:02 devstack sudo[78129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:17:04 devstack sudo[78129]: pam_unix(sudo:session): session closed for user root Sep 17 07:17:04 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.187s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:17:04 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:17:04 devstack sudo[78135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:17:04 devstack sudo[78135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:17:06 devstack sudo[78135]: pam_unix(sudo:session): session closed for user root Sep 17 07:17:06 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.992s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:17:06 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:17:06 devstack sudo[78139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:17:06 devstack sudo[78139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:17:08 devstack sudo[78139]: pam_unix(sudo:session): session closed for user root Sep 17 07:17:08 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.048s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:17:08 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:17:08 devstack sudo[78145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:17:08 devstack sudo[78145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:17:10 devstack sudo[78145]: pam_unix(sudo:session): session closed for user root Sep 17 07:17:10 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.029s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:17:10 devstack cinder-volume[75526]: DEBUG cinder.manager [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Notifying Schedulers of capabilities ... {{(pid=75526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:17:59 devstack cinder-volume[75526]: DEBUG dbcounter [-] [75526] Writing DB stats cinder:SELECT=1 {{(pid=75526) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:17:59 devstack cinder-volume[75526]: DEBUG dbcounter [-] [75526] Writing DB stats cinder:UPDATE=1 {{(pid=75526) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:18:02 devstack cinder-volume[75526]: DEBUG oslo_service.periodic_task [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75526) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:18:02 devstack cinder-volume[75526]: DEBUG cinder.volume.drivers.lvm [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Updating volume stats {{(pid=75526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 07:18:02 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:18:02 devstack sudo[78859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:18:02 devstack sudo[78859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:04 devstack sudo[78859]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:04 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.986s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:18:04 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:18:04 devstack sudo[78886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:18:04 devstack sudo[78886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:06 devstack sudo[78886]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:06 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.102s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:18:06 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:18:06 devstack sudo[79014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:18:06 devstack sudo[79014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:08 devstack sudo[79014]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:08 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.038s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:18:08 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:18:08 devstack sudo[79095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:18:08 devstack sudo[79095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:18:10 devstack sudo[79095]: pam_unix(sudo:session): session closed for user root Sep 17 07:18:10 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.006s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:18:10 devstack cinder-volume[75526]: DEBUG cinder.manager [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Notifying Schedulers of capabilities ... {{(pid=75526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:19:02 devstack cinder-volume[75526]: DEBUG oslo_service.periodic_task [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75526) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:19:02 devstack cinder-volume[75526]: DEBUG cinder.volume.drivers.lvm [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Updating volume stats {{(pid=75526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 07:19:02 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:19:02 devstack sudo[81645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:19:02 devstack sudo[81645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:04 devstack sudo[81645]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:04 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.817s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:19:04 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:19:04 devstack sudo[81648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:19:04 devstack sudo[81648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:06 devstack sudo[81648]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:06 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.858s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:19:06 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:19:06 devstack sudo[81652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:19:06 devstack sudo[81652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:07 devstack sudo[81652]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:07 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.777s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:19:07 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:19:07 devstack sudo[81655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:19:07 devstack sudo[81655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:19:09 devstack sudo[81655]: pam_unix(sudo:session): session closed for user root Sep 17 07:19:09 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.899s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:19:09 devstack cinder-volume[75526]: DEBUG cinder.manager [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Notifying Schedulers of capabilities ... {{(pid=75526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:19:59 devstack cinder-volume[75526]: DEBUG dbcounter [-] [75526] Writing DB stats cinder:SELECT=1 {{(pid=75526) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:19:59 devstack cinder-volume[75526]: DEBUG dbcounter [-] [75526] Writing DB stats cinder:UPDATE=1 {{(pid=75526) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:20:02 devstack cinder-volume[75526]: DEBUG oslo_service.periodic_task [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75526) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:20:02 devstack cinder-volume[75526]: DEBUG cinder.volume.drivers.lvm [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Updating volume stats {{(pid=75526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 07:20:02 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:20:02 devstack sudo[81948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:20:02 devstack sudo[81948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:04 devstack sudo[81948]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:04 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.795s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:20:04 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:20:04 devstack sudo[81951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:20:04 devstack sudo[81951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:05 devstack sudo[81951]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:06 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.838s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:20:06 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:20:06 devstack sudo[81954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:20:06 devstack sudo[81954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:07 devstack sudo[81954]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:07 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.864s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:20:07 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:20:08 devstack sudo[81957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:20:08 devstack sudo[81957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:20:09 devstack sudo[81957]: pam_unix(sudo:session): session closed for user root Sep 17 07:20:09 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.790s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:20:09 devstack cinder-volume[75526]: DEBUG cinder.manager [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Notifying Schedulers of capabilities ... {{(pid=75526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:21:02 devstack cinder-volume[75526]: DEBUG oslo_service.periodic_task [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75526) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:21:02 devstack cinder-volume[75526]: DEBUG cinder.volume.drivers.lvm [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Updating volume stats {{(pid=75526) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 17 07:21:02 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:21:02 devstack sudo[82371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 07:21:02 devstack sudo[82371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:05 devstack sudo[82371]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:05 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.955s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:21:05 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:21:05 devstack sudo[82495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:21:05 devstack sudo[82495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:07 devstack sudo[82495]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:07 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.417s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:21:07 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:21:07 devstack sudo[82622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 07:21:07 devstack sudo[82622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:10 devstack sudo[82622]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:10 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.451s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:21:10 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:21:10 devstack sudo[82639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 07:21:10 devstack sudo[82639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:21:12 devstack sudo[82639]: pam_unix(sudo:session): session closed for user root Sep 17 07:21:12 devstack cinder-volume[75526]: DEBUG oslo_concurrency.processutils [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.596s {{(pid=75526) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:21:12 devstack cinder-volume[75526]: DEBUG cinder.manager [None req-17de971e-9f7c-4585-9067-48f98510bc16 None None] Notifying Schedulers of capabilities ... {{(pid=75526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:21:26 devstack cinder-volume[75404]: INFO oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Caught SIGTERM, stopping children Sep 17 07:21:26 devstack cinder-volume[75404]: DEBUG oslo_concurrency.lockutils [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Acquiring lock "singleton_lock" {{(pid=75404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 17 07:21:26 devstack cinder-volume[75404]: DEBUG oslo_concurrency.lockutils [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Acquired lock "singleton_lock" {{(pid=75404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 17 07:21:26 devstack cinder-volume[75404]: DEBUG oslo_concurrency.lockutils [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Releasing lock "singleton_lock" {{(pid=75404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 17 07:21:26 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Stop services. {{(pid=75404) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}} Sep 17 07:21:26 devstack cinder-volume[75404]: DEBUG oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Killing children. {{(pid=75404) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}} Sep 17 07:21:26 devstack cinder-volume[75404]: INFO oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Waiting on 1 children to exit Sep 17 07:21:30 devstack cinder-volume[75526]: DEBUG oslo_concurrency.lockutils [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Acquiring lock "singleton_lock" {{(pid=75526) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 17 07:21:30 devstack cinder-volume[75526]: DEBUG oslo_concurrency.lockutils [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Acquired lock "singleton_lock" {{(pid=75526) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 17 07:21:30 devstack cinder-volume[75526]: DEBUG oslo_concurrency.lockutils [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Releasing lock "singleton_lock" {{(pid=75526) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 17 07:21:30 devstack cinder-volume[75526]: WARNING amqp [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 07:21:30 devstack cinder-volume[75526]: WARNING amqp [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 07:21:30 devstack cinder-volume[75404]: INFO oslo_service.backend._eventlet.service [None req-9b0a70c0-de9a-422e-abf5-18f211a0b2ea None None] Child 75526 exited with status 0 Sep 17 07:21:48 devstack cinder-volume[82976]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82976) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 17 07:21:48 devstack cinder-volume[82976]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82976) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 17 07:21:48 devstack cinder-volume[82976]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82976) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 17 07:21:51 devstack cinder-volume[82976]: INFO dbcounter [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] Registered counter for database cinder Sep 17 07:21:51 devstack cinder-volume[82976]: DEBUG oslo_db.sqlalchemy.engines [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82976) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 07:21:51 devstack cinder-volume[82976]: DEBUG dbcounter [-] [82976] Writer thread running {{(pid=82976) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 17 07:21:51 devstack cinder-volume[82976]: INFO cinder.rpc [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 07:21:51 devstack cinder-volume[82976]: INFO cinder.rpc [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 07:21:51 devstack cinder-volume[82976]: DEBUG oslo_db.sqlalchemy.engines [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82976) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 07:21:51 devstack cinder-volume[82976]: INFO cinder.volume.manager [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] Determined volume DB was empty at startup. Sep 17 07:21:51 devstack cinder-volume[82976]: DEBUG cinder.volume.manager [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82976) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 17 07:21:51 devstack cinder-volume[82976]: INFO cinder.volume.manager [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 07:21:51 devstack cinder-volume[82976]: WARNING stevedore.named [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 07:21:51 devstack cinder-volume[82976]: WARNING castellan.key_manager [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 07:21:51 devstack cinder-volume[82976]: WARNING cinder.keymgr.conf_key_mgr [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 07:21:51 devstack cinder-volume[82976]: INFO cinder.volume.manager [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 17 07:21:51 devstack cinder-volume[82976]: DEBUG oslo_db.sqlalchemy.engines [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82976) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 07:21:52 devstack cinder-volume[82976]: INFO oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] Starting 1 workers Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] Started child 83207 {{(pid=82976) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] Full set of CONF: {{(pid=82976) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] ******************************************************************************** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] Configuration options gathered from: {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] ================================================================================ {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] allow_availability_zone_fallback = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] allow_compression_on_image_upload = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] allowed_direct_url_schemes = [] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] api_rate_limit = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] auth_strategy = keystone {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[83207]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.1) Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_availability_zone = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_host = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_name = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_stats_polling_interval = 60 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backup_api_class = cinder.backup.api.API {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backup_name_template = backup-%s {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backup_use_same_host = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backup_use_temp_snapshot = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] chap_password = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] chap_username = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cinder_internal_tenant_project_id = f1935ed7e6e946d09ef9534b324cb3ef {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cinder_internal_tenant_user_id = a7129fba7e92404cb21f24749bb504ab {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cluster = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] compression_format = gzip {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] compute_api_class = cinder.compute.nova.API {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] config_dir = [] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] config_source = [] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] control_exchange = openstack {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] debug = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] default_availability_zone = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] default_group_type = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] default_volume_type = QuobyteHD {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] driver_client_cert = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] driver_client_cert_key = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] driver_data_namespace = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] driver_ssl_cert_path = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] driver_ssl_cert_verify = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] driver_use_ssl = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] enable_new_services = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] enable_unsupported_driver = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] enabled_backends = ['QuobyteHD'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] enforce_multipath_for_image_xfer = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] filter_function = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] glance_api_insecure = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] glance_api_servers = ['http://192.168.122.170/image'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] glance_api_ssl_compression = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] glance_ca_certificates_file = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] glance_catalog_info = image:glance:publicURL {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] glance_certfile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] glance_keyfile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] glance_num_retries = 3 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] glance_request_timeout = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] goodness_function = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] graceful_shutdown_timeout = 5 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] group_api_class = cinder.group.api.API {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] host = devstack {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] image_compress_on_upload = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] image_conversion_address_space_limit = 1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] image_conversion_cpu_limit = 60 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] image_conversion_disable = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] image_upload_use_cinder_backend = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] image_upload_use_internal_tenant = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] image_volume_cache_enabled = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] image_volume_cache_max_count = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] image_volume_cache_max_size_gb = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] init_host_max_objects_retrieval = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] instance_format = [instance: %(uuid)s] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] iscsi_iotype = fileio {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] iscsi_target_flags = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] iscsi_write_cache = on {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] iser_helper = tgtadm {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] iser_ip_address = 192.168.122.170 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] iser_port = 3260 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] log_color = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] log_config_append = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] log_dir = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] log_file = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] log_options = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] log_rotate_interval = 1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] log_rotate_interval_type = days {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] log_rotation_type = none {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] max_age = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] max_logfile_count = 30 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] max_logfile_size_mb = 200 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] max_over_subscription_ratio = 20.0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] message_reap_interval = 86400 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] message_ttl = 2592000 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] migration_create_volume_timeout_secs = 300 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] monkey_patch = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] monkey_patch_modules = [] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] my_ip = 192.168.122.170 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] no_snapshot_gb_quota = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] num_iser_scan_tries = 3 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] num_shell_tries = 3 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] num_volume_device_scan_tries = 3 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] nvmeof_conn_info_version = 1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] nvmet_ns_id = 10 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] nvmet_port_id = 1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] osapi_max_limit = 1000 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] osapi_volume_ext_list = [] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] osapi_volume_listen_port = 8776 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] osapi_volume_use_ssl = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] osapi_volume_workers = 2 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] per_volume_size_limit = -1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] periodic_fuzzy_delay = 60 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] periodic_interval = 60 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] public_endpoint = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] publish_errors = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] quota_backup_gigabytes = 1000 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] quota_backups = 10 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] quota_gigabytes = 1000 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] quota_groups = 10 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] quota_snapshots = 10 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] quota_volumes = 10 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] rate_limit_burst = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] rate_limit_except_level = CRITICAL {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] rate_limit_interval = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] reinit_driver_count = 3 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] replication_device = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] report_discard_supported = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] report_interval = 120 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] reservation_clean_interval = 86400 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] reservation_expire = 86400 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] reserved_image_namespaces = [] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] reserved_percentage = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] rpc_response_timeout = 120 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] run_external_periodic_tasks = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] scst_target_driver = iscsi {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] scst_target_iqn_name = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] service_down_time = 720 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] shell_completion = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] snapshot_name_template = snapshot-%s {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] split_loggers = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] state_path = /opt/stack/data/cinder {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] storage_availability_zone = nova {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] storage_protocol = iSCSI {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] syslog_log_facility = LOG_USER {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] target_helper = lioadm {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] target_ip_address = 192.168.122.170 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] target_port = 3260 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] target_protocol = iscsi {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] target_secondary_ip_addresses = [] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] trace_flags = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] transport_url = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] until_refresh = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] use_chap_auth = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] use_default_quota_class = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] use_journal = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] use_json = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] use_multipath_for_image_xfer = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] use_stderr = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] use_syslog = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] verify_glance_signatures = enabled {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] volume_api_class = cinder.volume.api.API {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] volume_backend_name = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] volume_clear = zero {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] volume_clear_ionice = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] volume_clear_size = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] volume_copy_bps_limit = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] volume_dd_blocksize = 1M {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] volume_name_template = volume-%s {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] volume_service_inithost_offload = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] volume_usage_audit_period = month {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] watch_log_file = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] zoning_mode = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_concurrency.disable_process_locking = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.admin_password = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.admin_token = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.admin_user = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.auth_port = 35357 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.auth_protocol = https {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.auth_section = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.auth_type = password {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.auth_uri = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.auth_version = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.cache = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.certfile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.identity_uri = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.include_service_catalog = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.insecure = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.interface = public {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.keyfile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_password = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcache_username = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.region_name = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Starting volume driver QuobyteDriver (1.1.13) Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.service_type = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83207) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.backend = dogpile.cache.null {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.backend_argument = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.backend_expiration_time = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.config_prefix = cache.oslo {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.dead_timeout = 60.0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.debug_cache_backend = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.enable_retry_client = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.enable_socket_keepalive = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.enabled = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.enforce_fips_mode = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.expiration_time = 600 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.hashclient_retry_attempts = 2 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.hashclient_retry_delay = 1.0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.memcache_dead_retry = 300 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.memcache_password = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.memcache_pool_maxsize = 10 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.memcache_sasl_enabled = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.memcache_socket_timeout = 1.0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.memcache_username = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.proxies = [] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.redis_db = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.redis_password = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.redis_server = localhost:6379 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.redis_socket_timeout = 1.0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.redis_username = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.retry_attempts = 2 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.retry_delay = 0.0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.socket_keepalive_count = 1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.socket_keepalive_idle = 1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.socket_keepalive_interval = 1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.tls_allowed_ciphers = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.tls_cafile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.tls_certfile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.tls_enabled = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cache.tls_keyfile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] coordination.backend_url = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.asyncio_connection = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.asyncio_slave_connection = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.backend = sqlalchemy {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.connection = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.connection_debug = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.connection_parameters = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.connection_recycle_time = 3600 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.connection_trace = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.db_inc_retry_interval = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.db_max_retries = 20 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.db_max_retry_interval = 10 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.db_retry_interval = 1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.max_overflow = 50 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.max_pool_size = 5 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.max_retries = 10 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.mysql_wsrep_sync_wait = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.pool_timeout = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.retry_interval = 10 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.slave_connection = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.sqlite_synchronous = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] database.use_db_reconnect = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] profiler.connection_string = messaging:// {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] profiler.enabled = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] profiler.es_doc_type = notification {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] profiler.es_scroll_size = 10000 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] profiler.es_scroll_time = 2m {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] profiler.filter_error_trace = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] profiler.hmac_keys = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] profiler.sentinel_service_name = mymaster {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] profiler.socket_timeout = 0.1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] profiler.trace_requests = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] profiler.trace_sqlalchemy = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] profiler_jaeger.process_tags = {} {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] profiler_jaeger.service_name_prefix = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] profiler_otlp.service_name_prefix = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_policy.enforce_new_defaults = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: WARNING oslo_config.cfg [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_policy.enforce_scope = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_policy.policy_default_rule = default {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_policy.policy_file = policy.yaml {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] privsep_osbrick.group = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] privsep_osbrick.helper_command = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] privsep_osbrick.user = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cinder_sys_admin.group = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cinder_sys_admin.helper_command = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] cinder_sys_admin.user = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] service_user.auth_section = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] service_user.auth_type = password {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] service_user.certfile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] service_user.collect_timing = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] service_user.insecure = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] service_user.keyfile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] service_user.send_service_user_token = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] service_user.split_loggers = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] service_user.timeout = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.backend_availability_zone = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.chap_password = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.chap_username = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.driver_client_cert = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.driver_client_cert_key = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.driver_data_namespace = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.driver_use_ssl = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.extra_capabilities = {} {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.filter_function = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.goodness_function = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.iscsi_iotype = fileio {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.iscsi_target_flags = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.iscsi_write_cache = on {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.iser_helper = tgtadm {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.iser_ip_address = 192.168.122.170 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.iser_port = 3260 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.nas_host = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.nas_login = admin {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.nas_mount_options = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.nas_password = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.nas_private_key = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.nas_share_path = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.num_shell_tries = 3 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.quobyte_volume_url = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.replication_device = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.report_discard_supported = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.reserved_percentage = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.target_helper = tgtadm {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.target_ip_address = 192.168.122.170 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.target_port = 3260 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.target_protocol = iscsi {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.trace_flags = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.unique_fqdn_network = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.use_chap_auth = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.volume_backend_name = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.volume_clear = zero {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.volume_clear_ionice = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.volume_clear_size = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_reports.file_event_handler = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_reports.log_dir = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.backend_availability_zone = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.backend_host = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.chap_password = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.chap_username = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.chiscsi_conf = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.driver_client_cert = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.driver_data_namespace = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.driver_use_ssl = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.extra_capabilities = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.filter_function = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.goodness_function = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.iscsi_iotype = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.iser_helper = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.iser_ip_address = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.iser_port = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.iser_target_prefix = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.nas_host = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.nas_login = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.nas_mount_options = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.nas_password = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.nas_private_key = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.nas_share_path = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.nas_ssh_port = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.num_shell_tries = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.nvmet_port_id = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.quobyte_volume_url = quobyte://10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.replication_device = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.report_discard_supported = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.reserved_percentage = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.scst_target_driver = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.storage_protocol = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.target_helper = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.target_ip_address = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.target_port = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.target_prefix = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.target_protocol = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.trace_flags = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.use_chap_auth = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.volume_clear = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.volume_clear_size = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] QuobyteHD.volumes_dir = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.ssl = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_notifications.driver = [] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_notifications.retry = -1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] key_manager.fixed_key = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.barbican_api_version = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.barbican_endpoint = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.barbican_endpoint_type = public {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.barbican_region_name = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.cafile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.certfile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.collect_timing = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.insecure = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.keyfile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.number_of_retries = 60 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.retry_delay = 1 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.send_service_user_token = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.split_loggers = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.timeout = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.verify_ssl = True {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican.verify_ssl_path = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican_service_user.auth_section = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican_service_user.auth_type = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican_service_user.cafile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican_service_user.certfile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican_service_user.collect_timing = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican_service_user.insecure = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican_service_user.keyfile = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican_service_user.split_loggers = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] barbican_service_user.timeout = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] vault.approle_role_id = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] vault.approle_secret_id = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] vault.kv_mountpoint = secret {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] vault.kv_path = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] vault.kv_version = 2 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] vault.namespace = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] vault.root_token_id = **** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] vault.ssl_ca_crt_file = None {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] vault.timeout = 60.0 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] vault.use_ssl = False {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 17 07:21:52 devstack cinder-volume[82976]: DEBUG oslo_service.backend._eventlet.service [None req-ee0ed12c-ca91-42a9-bf3f-109c0b120905 None None] ******************************************************************************** {{(pid=82976) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 17 07:21:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83207) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 17 07:21:52 devstack cinder-volume[83207]: INFO cinder.volume.drivers.quobyte [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual. Sep 17 07:21:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Running cmd (subprocess): mount.quobyte {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:21:53 devstack quobyte-client[83217]: Reading configuration file: /etc/quobyte/client.cfg Sep 17 07:21:53 devstack quobyte-client[83217]: Invalid parameters found, error: missing mount point. Sep 17 07:21:53 devstack quobyte-client[83217]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 17 07:21:53 devstack quobyte-client[83217]: Failed to parse all commandline parameters, please use -h/--help to see available options. Sep 17 07:21:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] CMD "mount.quobyte" returned: 1 in 0.448s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:21:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:21:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:21:53 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:21:53 devstack cinder-volume[83207]: INFO cinder.volume.drivers.quobyte [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Mounting volume: 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe ... Sep 17 07:21:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 -c /etc/quobyte/client-cinder.cfg {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:21:53 devstack quobyte-client[83218]: Reading configuration file: /etc/quobyte/client-cinder.cfg Sep 17 07:21:53 devstack quobyte-client[83218]: Reading configuration file: /etc/quobyte/client.cfg Sep 17 07:21:53 devstack quobyte-client[83218]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7' to display the log. Sep 17 07:21:53 devstack quobyte-client[83219]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic). Sep 17 07:21:53 devstack quobyte-client[83219]: mount.quobyte 3.25 (4fbbd59204) Sep 17 07:21:53 devstack quobyte-client[83219]: Client UUID: OeMGgYKz-6pIf-kuzu-tW16-8vpPTUsHAxg8 Sep 17 07:21:53 devstack quobyte-client[83219]: Registry: osci01.corp.quobyte.com:7861 Sep 17 07:21:53 devstack quobyte-client[83219]: Volume: cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:21:53 devstack quobyte-client[83219]: FUSE version: 316 Sep 17 07:21:53 devstack quobyte-client[83219]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps) Sep 17 07:21:53 devstack quobyte-client[83219]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied Sep 17 07:21:53 devstack quobyte-client[83219]: Setting total object cache size to 3352297472 bytes Sep 17 07:21:53 devstack quobyte-client[83219]: Using FUSE low-level API Sep 17 07:21:53 devstack quobyte-client[83219]: Caching of uid/gid to user/group name mappings is enabled Sep 17 07:21:53 devstack quobyte-client[83219]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10 Sep 17 07:21:53 devstack quobyte-client[83219]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab. Sep 17 07:21:53 devstack quobyte-client[83219]: HTTP server started on port 55000 Sep 17 07:21:53 devstack quobyte-client[83219]: Caching mappings from uid/gid to user/group name and group membership temporarily. Sep 17 07:21:53 devstack quobyte-client[83219]: Mount point /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 established Sep 17 07:21:53 devstack quobyte-client[83219]: TimeSync is running and remote sync every 60 seconds Sep 17 07:21:53 devstack quobyte-client[83219]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 17 07:21:53 devstack quobyte-client[83219]: Ignored time synchronization message because time source took too long to respond (52 ms) Sep 17 07:21:53 devstack quobyte-client[83219]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 17 07:21:53 devstack quobyte-client[83219]: Opening volume cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe (b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14) Sep 17 07:21:53 devstack quobyte-client[83219]: Setting metadata cache size to 500000 based on available system memory of 16 GiB Sep 17 07:21:53 devstack quobyte-client[83219]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 17 07:21:53 devstack quobyte-client[83219]: Failed to invalidate inode: 38: Function not implemented Sep 17 07:21:53 devstack quobyte-client[83219]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 17 07:21:53 devstack quobyte-client[83219]: Automatic minidump upload enabled by global system configuration Sep 17 07:21:53 devstack quobyte-client[83219]: Announcing HTTP status server address 172.24.4.1 Sep 17 07:21:53 devstack quobyte-client[83219]: Registered as service (uuid OeMGgYKz-6pIf-kuzu-tW16-8vpPTUsHAxg8) Sep 17 07:21:53 devstack quobyte-client[83219]: Quobyte Client running as pid 83219 Sep 17 07:21:53 devstack quobyte-client[83219]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2 Sep 17 07:21:53 devstack quobyte-client[83219]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl Sep 17 07:21:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.641s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:21:53 devstack cinder-volume[83207]: INFO cinder.volume.drivers.quobyte [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Mounting volume: 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe succeeded Sep 17 07:21:53 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:21:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.733s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:21:54 devstack quobyte-client[83219]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.112s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:21:54 devstack cinder-volume[83207]: INFO cinder.volume.driver [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Driver hasn't implemented _init_vendor_properties() Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG cinder.volume.driver [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83207) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:844}} Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG oslo_db.sqlalchemy.engines [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83207) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writer thread running {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG cinder.db.sqlalchemy.api [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Building query based on filter {{(pid=83207) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83207) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 17 07:21:54 devstack cinder-volume[83207]: INFO cinder.keymgr.migration [None req-55a067eb-35d9-425e-9ad8-686f5fb9864e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.099s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:21:54 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:21:54 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Driver initialization completed successfully. Sep 17 07:21:55 devstack cinder-volume[83207]: INFO cinder.manager [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Initiating service 3 cleanup Sep 17 07:21:55 devstack cinder-volume[83207]: INFO cinder.manager [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Service 3 cleanup completed. Sep 17 07:21:55 devstack cinder-volume[83207]: DEBUG cinder.service [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Creating RPC server for service cinder-volume {{(pid=83207) start /opt/stack/cinder/cinder/service.py:239}} Sep 17 07:21:55 devstack cinder-volume[83207]: DEBUG cinder.service [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83207) start /opt/stack/cinder/cinder/service.py:245}} Sep 17 07:21:55 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13) Sep 17 07:21:55 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:21:55 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:21:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:21:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:21:55 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:21:55 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:21:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:21:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:21:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.133s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:21:55 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-657b0ff6-a9e0-4008-984b-4d375f95511a None None] Driver post RPC initialization completed successfully. Sep 17 07:21:56 devstack quobyte-client[83219]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 17 07:22:02 devstack cinder-volume[82976]: DEBUG dbcounter [-] [82976] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82976) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:22:05 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:22:05 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:23:06 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:23:06 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Flow 'volume_create_manager' (bf39223c-33ce-480f-b215-400960654ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78d8e41-8bc1-463a-aa8f-9a95800c26b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78d8e41-8bc1-463a-aa8f-9a95800c26b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1423833355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6e58ce-9fe9-4820-8a20-10d29454abfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680333e297f04a10ace49dac0c173105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:23:06Z,use_quota=True,user_id='dfe1264af1ba40698f974cc1f303e1ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611e2942-bef7-47fb-b0e8-0e419d7c41bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611e2942-bef7-47fb-b0e8-0e419d7c41bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e87b7e1-9d2a-43ba-85e2-416e552d437f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e87b7e1-9d2a-43ba-85e2-416e552d437f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c6e58ce-9fe9-4820-8a20-10d29454abfe', 'volume_name': 'volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539c16a6-6304-4ede-bfd4-ab7429865922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (539c16a6-6304-4ede-bfd4-ab7429865922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4680db02-5049-4b3c-b7b8-f64500081d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:23:07 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Volume 2c6e58ce-9fe9-4820-8a20-10d29454abfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe', 'volume_size': 1} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1423833355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6e58ce-9fe9-4820-8a20-10d29454abfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680333e297f04a10ace49dac0c173105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:23:06Z,use_quota=True,user_id='dfe1264af1ba40698f974cc1f303e1ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Creating volume 2c6e58ce-9fe9-4820-8a20-10d29454abfe {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:23:07 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:23:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:23:07 devstack quobyte-client[83219]: System call of process 83552 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:23:08 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=2, name=volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:23:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe 1073741824" returned: 0 in 1.473s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:23:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:23:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe" returned: 0 in 0.231s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:23:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] <== create_volume: return (1911ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:23:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:23:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4680db02-5049-4b3c-b7b8-f64500081d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:23:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479a72e5-8c43-40e8-b53e-fbfcd0ac72c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:23:10 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Volume volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe (2c6e58ce-9fe9-4820-8a20-10d29454abfe): created successfully Sep 17 07:23:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479a72e5-8c43-40e8-b53e-fbfcd0ac72c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:23:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Flow 'volume_create_manager' (bf39223c-33ce-480f-b215-400960654ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:23:10 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-48b580d9-6a60-4cb1-8791-fb920cd2524b tempest-VolumesAssistedSnapshotsTest-1872827601 None] Created volume successfully. Sep 17 07:23:20 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=3 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:23:20 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:23:22 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:23:22 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:23:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Flow 'volume_create_manager' (4dcc2fc5-66a3-4131-9b16-cfc3b8151a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:23:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22299b48-38fd-4802-b0f2-aa0263b14cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:23:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22299b48-38fd-4802-b0f2-aa0263b14cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1150239564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a8ea8d-b798-443b-8953-17a38dd1e1c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e803c88adf74386922608e3d1aebd44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:23:22Z,use_quota=True,user_id='84c461ae7038476987dd70addb4e6935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:23:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b079c8e-64fd-46f6-8af5-54aa658dadf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:23:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b079c8e-64fd-46f6-8af5-54aa658dadf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:23:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c161f4eb-dbd8-48fe-b49f-92b273194fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c161f4eb-dbd8-48fe-b49f-92b273194fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a8ea8d-b798-443b-8953-17a38dd1e1c1', 'volume_name': 'volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b48d20-f16b-440d-b5d4-f8ddc43c7e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b48d20-f16b-440d-b5d4-f8ddc43c7e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47988714-e133-401f-a5bb-902060539cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:23:24 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Volume d2a8ea8d-b798-443b-8953-17a38dd1e1c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1', 'volume_size': 1} Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1150239564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a8ea8d-b798-443b-8953-17a38dd1e1c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e803c88adf74386922608e3d1aebd44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:23:22Z,use_quota=True,user_id='84c461ae7038476987dd70addb4e6935',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Creating volume d2a8ea8d-b798-443b-8953-17a38dd1e1c1 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:23:24 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:23:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:23:24 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=3, name=volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:23:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1 1073741824" returned: 0 in 0.747s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:23:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:23:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1" returned: 0 in 0.619s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:23:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] <== create_volume: return (1869ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:23:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:23:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47988714-e133-401f-a5bb-902060539cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:23:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9663f5-c8c9-498e-84e4-4b89f4ac555b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:23:26 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Volume volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1 (d2a8ea8d-b798-443b-8953-17a38dd1e1c1): created successfully Sep 17 07:23:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9663f5-c8c9-498e-84e4-4b89f4ac555b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:23:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Flow 'volume_create_manager' (4dcc2fc5-66a3-4131-9b16-cfc3b8151a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:23:26 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-fc7c76d0-b00b-4069-b297-b6592ff1eae7 tempest-DeleteServersTestJSON-698808233 None] Created volume successfully. Sep 17 07:23:26 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:23:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:23:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:23:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:23:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:23:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:23:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:23:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.585s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:23:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:23:36 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:23:36 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:24:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-0a435178-a71e-4e68-b838-57e3af3cf6a4 req-6b55447d-9936-4d90-90c3-ac4276aa9b13 tempest-DeleteServersTestJSON-698808233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:24:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-0a435178-a71e-4e68-b838-57e3af3cf6a4 req-6b55447d-9936-4d90-90c3-ac4276aa9b13 tempest-DeleteServersTestJSON-698808233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.018s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:24:05 devstack cinder-volume[83207]: INFO oslo.privsep.daemon [req-0a435178-a71e-4e68-b838-57e3af3cf6a4 req-6b55447d-9936-4d90-90c3-ac4276aa9b13 tempest-DeleteServersTestJSON-698808233 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp43yqslzc/privsep.sock'] Sep 17 07:24:06 devstack sudo[84252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp43yqslzc/privsep.sock Sep 17 07:24:06 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:24:15 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:24:15 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:24:26 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:24:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:24:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:24:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:24:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:24:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:24:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:24:27 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root Sep 17 07:24:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.260s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:24:27 devstack cinder-volume[83207]: INFO oslo.privsep.daemon [req-0a435178-a71e-4e68-b838-57e3af3cf6a4 req-6b55447d-9936-4d90-90c3-ac4276aa9b13 tempest-DeleteServersTestJSON-698808233 None] Spawned new privsep daemon via rootwrap Sep 17 07:24:27 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [req-0a435178-a71e-4e68-b838-57e3af3cf6a4 req-6b55447d-9936-4d90-90c3-ac4276aa9b13 tempest-DeleteServersTestJSON-698808233 None] Accepted privsep connection to /tmp/tmp43yqslzc/privsep.sock {{(pid=83207) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}} Sep 17 07:24:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:24:27 devstack cinder-volume[83207]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 17 07:24:27 devstack cinder-volume[83207]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 17 07:24:27 devstack cinder-volume[83207]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 17 07:24:27 devstack cinder-volume[83207]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84353 Sep 17 07:24:27 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead880d8-7b66-4f23-8c57-b12d2e3bd4a1]: (2,) {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:24:27 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e185b7-5c68-4815-9f13-1b541759d625]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:24:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-0a435178-a71e-4e68-b838-57e3af3cf6a4 req-6b55447d-9936-4d90-90c3-ac4276aa9b13 tempest-DeleteServersTestJSON-698808233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:24:28 devstack quobyte-client[83219]: System call of process 84374 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:24:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-0a435178-a71e-4e68-b838-57e3af3cf6a4 req-6b55447d-9936-4d90-90c3-ac4276aa9b13 tempest-DeleteServersTestJSON-698808233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1" returned: 0 in 1.287s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:24:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-0a435178-a71e-4e68-b838-57e3af3cf6a4 req-6b55447d-9936-4d90-90c3-ac4276aa9b13 tempest-DeleteServersTestJSON-698808233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 23.247s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:24:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-0a435178-a71e-4e68-b838-57e3af3cf6a4 req-6b55447d-9936-4d90-90c3-ac4276aa9b13 tempest-DeleteServersTestJSON-698808233 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63706b87-960d-4874-86cb-421fd850fb83', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:24:30 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-0a435178-a71e-4e68-b838-57e3af3cf6a4 req-6b55447d-9936-4d90-90c3-ac4276aa9b13 tempest-DeleteServersTestJSON-698808233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:24:31 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-0a435178-a71e-4e68-b838-57e3af3cf6a4 req-6b55447d-9936-4d90-90c3-ac4276aa9b13 tempest-DeleteServersTestJSON-698808233 None] attachment_update completed successfully. Sep 17 07:24:41 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:24:41 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:24:57 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-17b218cd-2b1f-4c71-bcd4-8854232f4670 req-cb6b4106-176f-4bd6-b10a-a92f4ba76b4e tempest-DeleteServersTestJSON-698808233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:24:57 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-17b218cd-2b1f-4c71-bcd4-8854232f4670 req-cb6b4106-176f-4bd6-b10a-a92f4ba76b4e tempest-DeleteServersTestJSON-698808233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:24:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-17b218cd-2b1f-4c71-bcd4-8854232f4670 req-cb6b4106-176f-4bd6-b10a-a92f4ba76b4e tempest-DeleteServersTestJSON-698808233 None] Terminate volume connection completed successfully. Sep 17 07:24:57 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-17b218cd-2b1f-4c71-bcd4-8854232f4670 req-cb6b4106-176f-4bd6-b10a-a92f4ba76b4e tempest-DeleteServersTestJSON-698808233 None] Deleting attachment 63706b87-960d-4874-86cb-421fd850fb83. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:25:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Acquiring lock "cinder-d2a8ea8d-b798-443b-8953-17a38dd1e1c1-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:25:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Lock "cinder-d2a8ea8d-b798-443b-8953-17a38dd1e1c1-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:25:04 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:25:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Acquiring lock "cinder-quobyte-d2a8ea8d-b798-443b-8953-17a38dd1e1c1" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:25:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Lock "cinder-quobyte-d2a8ea8d-b798-443b-8953-17a38dd1e1c1" acquired by "delete_volume" :: waited 0.020s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:25:04 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c288e0ba-a69c-4e5d-9254-199cae57206a]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:25:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:25:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1" returned: 0 in 0.534s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:25:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:25:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d2a8ea8d-b798-443b-8953-17a38dd1e1c1" returned: 0 in 0.093s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:25:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Lock "cinder-quobyte-d2a8ea8d-b798-443b-8953-17a38dd1e1c1" released by "delete_volume" :: held 0.793s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:25:05 devstack cinder-volume[83207]: WARNING cinder.quota [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:25:05 devstack cinder-volume[83207]: WARNING cinder.quota [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:25:05 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Created reservations ['012c656a-4086-4865-a4b7-9058e79702d1', '08c1db0e-4ff0-41e7-b3bc-e0bab5f249f3', 'd5a7298f-643e-4946-a556-cff31bb023a5', 'b12ce083-39f7-4f90-8f34-fc9b840018cc'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:25:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:25:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:25:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:25:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:25:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:25:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:25:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.120s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:25:06 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:25:06 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Deleted volume successfully. Sep 17 07:25:06 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f7dddfb1-a018-4748-ad03-429154308eb4 tempest-DeleteServersTestJSON-698808233 None] Lock "cinder-d2a8ea8d-b798-443b-8953-17a38dd1e1c1-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:25:15 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:INSERT=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:25:16 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=9,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:25:26 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:25:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:25:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:25:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:25:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:25:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:25:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 1.052s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:25:28 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Flow 'volume_create_manager' (e93bf573-5ad0-4998-ad90-63230387df6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efb9994-b4b2-41f1-b24f-4ba0e253edc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efb9994-b4b2-41f1-b24f-4ba0e253edc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1001999567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab2899c-8920-4298-b2ee-efc682c3c228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e7119e121a4b8fb38765e67c12ebe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:25:27Z,use_quota=True,user_id='4bea08d264e445719351d930a9f83e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003dfdcf-41cb-45e9-b672-3a7bc8e1c22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003dfdcf-41cb-45e9-b672-3a7bc8e1c22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07ffe53-e49c-4c90-a54e-47eb00ff1c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07ffe53-e49c-4c90-a54e-47eb00ff1c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab2899c-8920-4298-b2ee-efc682c3c228', 'volume_name': 'volume-5ab2899c-8920-4298-b2ee-efc682c3c228', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541c6dd6-f269-42a5-a54b-fbc565cb4cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541c6dd6-f269-42a5-a54b-fbc565cb4cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0d62c1-8cdc-498d-bee9-eb21cf5fa312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:25:28 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Volume 5ab2899c-8920-4298-b2ee-efc682c3c228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab2899c-8920-4298-b2ee-efc682c3c228', 'volume_size': 1} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1001999567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab2899c-8920-4298-b2ee-efc682c3c228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18e7119e121a4b8fb38765e67c12ebe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:25:27Z,use_quota=True,user_id='4bea08d264e445719351d930a9f83e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Creating volume 5ab2899c-8920-4298-b2ee-efc682c3c228 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:25:28 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:25:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5ab2899c-8920-4298-b2ee-efc682c3c228 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:25:28 devstack quobyte-client[83219]: System call of process 85207 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:25:29 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=4, name=volume-5ab2899c-8920-4298-b2ee-efc682c3c228, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:25:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5ab2899c-8920-4298-b2ee-efc682c3c228 1073741824" returned: 0 in 1.130s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:25:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5ab2899c-8920-4298-b2ee-efc682c3c228 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:25:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5ab2899c-8920-4298-b2ee-efc682c3c228" returned: 0 in 0.242s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:25:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] <== create_volume: return (1658ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:25:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:25:31 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0d62c1-8cdc-498d-bee9-eb21cf5fa312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab2899c-8920-4298-b2ee-efc682c3c228', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:25:31 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8cd1e18-3f87-43e3-8313-44e872f48d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:25:31 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Volume volume-5ab2899c-8920-4298-b2ee-efc682c3c228 (5ab2899c-8920-4298-b2ee-efc682c3c228): created successfully Sep 17 07:25:31 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8cd1e18-3f87-43e3-8313-44e872f48d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:25:31 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Flow 'volume_create_manager' (e93bf573-5ad0-4998-ad90-63230387df6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:25:31 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d5058106-4001-4ab6-886b-ad14b5134dc1 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Created volume successfully. Sep 17 07:25:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-4b5f46c1-22ed-4d26-bb25-bdf617588ece req-c4f883b7-b435-417e-af38-850b307755ab tempest-AttachSCSIVolumeTestJSON-1505792526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:25:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-4b5f46c1-22ed-4d26-bb25-bdf617588ece req-c4f883b7-b435-417e-af38-850b307755ab tempest-AttachSCSIVolumeTestJSON-1505792526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:25:37 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e86296-5ff3-4516-97cb-fcc2d6e78545]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:25:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-4b5f46c1-22ed-4d26-bb25-bdf617588ece req-c4f883b7-b435-417e-af38-850b307755ab tempest-AttachSCSIVolumeTestJSON-1505792526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5ab2899c-8920-4298-b2ee-efc682c3c228 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:25:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-4b5f46c1-22ed-4d26-bb25-bdf617588ece req-c4f883b7-b435-417e-af38-850b307755ab tempest-AttachSCSIVolumeTestJSON-1505792526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5ab2899c-8920-4298-b2ee-efc682c3c228" returned: 0 in 0.668s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:25:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-4b5f46c1-22ed-4d26-bb25-bdf617588ece req-c4f883b7-b435-417e-af38-850b307755ab tempest-AttachSCSIVolumeTestJSON-1505792526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.771s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:25:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-4b5f46c1-22ed-4d26-bb25-bdf617588ece req-c4f883b7-b435-417e-af38-850b307755ab tempest-AttachSCSIVolumeTestJSON-1505792526 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-5ab2899c-8920-4298-b2ee-efc682c3c228', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8262117a-38bf-4ba7-ad01-c059dd6b8daf', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:25:38 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-4b5f46c1-22ed-4d26-bb25-bdf617588ece req-c4f883b7-b435-417e-af38-850b307755ab tempest-AttachSCSIVolumeTestJSON-1505792526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:25:39 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-4b5f46c1-22ed-4d26-bb25-bdf617588ece req-c4f883b7-b435-417e-af38-850b307755ab tempest-AttachSCSIVolumeTestJSON-1505792526 None] attachment_update completed successfully. Sep 17 07:25:49 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:25:49 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:25:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-837f3b65-de4a-49b3-9c18-91789215f795 req-7b33051d-4906-41d7-871d-0354316cd7aa tempest-VolumesAssistedSnapshotsTest-1872827601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:25:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-837f3b65-de4a-49b3-9c18-91789215f795 req-7b33051d-4906-41d7-871d-0354316cd7aa tempest-VolumesAssistedSnapshotsTest-1872827601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:25:50 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c11977-27ae-47b5-a9c4-977249ef1bfd]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:25:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-837f3b65-de4a-49b3-9c18-91789215f795 req-7b33051d-4906-41d7-871d-0354316cd7aa tempest-VolumesAssistedSnapshotsTest-1872827601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:25:51 devstack quobyte-client[83219]: System call of process 85691 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:25:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-837f3b65-de4a-49b3-9c18-91789215f795 req-7b33051d-4906-41d7-871d-0354316cd7aa tempest-VolumesAssistedSnapshotsTest-1872827601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe" returned: 0 in 0.792s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:25:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-837f3b65-de4a-49b3-9c18-91789215f795 req-7b33051d-4906-41d7-871d-0354316cd7aa tempest-VolumesAssistedSnapshotsTest-1872827601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.902s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:25:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-837f3b65-de4a-49b3-9c18-91789215f795 req-7b33051d-4906-41d7-871d-0354316cd7aa tempest-VolumesAssistedSnapshotsTest-1872827601 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2e9b299-9d83-4c76-990d-628d4df42a5e', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:25:51 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-837f3b65-de4a-49b3-9c18-91789215f795 req-7b33051d-4906-41d7-871d-0354316cd7aa tempest-VolumesAssistedSnapshotsTest-1872827601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:25:51 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-837f3b65-de4a-49b3-9c18-91789215f795 req-7b33051d-4906-41d7-871d-0354316cd7aa tempest-VolumesAssistedSnapshotsTest-1872827601 None] attachment_update completed successfully. Sep 17 07:26:01 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Flow 'volume_create_manager' (700ed446-ef12-45ef-a381-86e0eea1330e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a14acae-3947-47c1-ab10-72c04928894c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a14acae-3947-47c1-ab10-72c04928894c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2070722305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b92f26f-9f2b-4972-b1d7-28d964ce3452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93af7de53d764f7e9a8955e6dbfb19aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:26:01Z,use_quota=True,user_id='2aad61453f9e4ffa8fb77d35483b7f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5a8b73-bf71-4984-8749-22bc471ac496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5a8b73-bf71-4984-8749-22bc471ac496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8a02a3-bf01-4a32-a718-6f2c13c58e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8a02a3-bf01-4a32-a718-6f2c13c58e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b92f26f-9f2b-4972-b1d7-28d964ce3452', 'volume_name': 'volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b584ac-0fb9-4141-a716-a77b82e932dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b584ac-0fb9-4141-a716-a77b82e932dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be65fc5c-9ccb-4dc8-aa05-9123936edd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:26:01 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Volume 5b92f26f-9f2b-4972-b1d7-28d964ce3452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452', 'volume_size': 1} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2070722305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b92f26f-9f2b-4972-b1d7-28d964ce3452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93af7de53d764f7e9a8955e6dbfb19aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:26:01Z,use_quota=True,user_id='2aad61453f9e4ffa8fb77d35483b7f75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Creating volume 5b92f26f-9f2b-4972-b1d7-28d964ce3452 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:26:01 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:26:01 devstack quobyte-client[83219]: System call of process 85748 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:26:01 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=5, name=volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452 1073741824" returned: 0 in 0.371s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452" returned: 0 in 0.070s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] <== create_volume: return (501ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:26:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.512s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:26:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be65fc5c-9ccb-4dc8-aa05-9123936edd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:26:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5559e4c-1c84-4620-bacc-5233ffff307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:26:02 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Volume volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452 (5b92f26f-9f2b-4972-b1d7-28d964ce3452): created successfully Sep 17 07:26:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5559e4c-1c84-4620-bacc-5233ffff307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:26:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Flow 'volume_create_manager' (700ed446-ef12-45ef-a381-86e0eea1330e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:26:02 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4ad92a94-32f3-45f9-a69b-7fb12c10bee3 tempest-TaggedAttachmentsTest-2119376340 None] Created volume successfully. Sep 17 07:26:10 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-227eca62-2c69-466b-af35-b753b1603c86 req-5295faa1-fb28-4d89-ad78-02c9d5e55d19 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:26:11 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-227eca62-2c69-466b-af35-b753b1603c86 req-5295faa1-fb28-4d89-ad78-02c9d5e55d19 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:26:11 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-227eca62-2c69-466b-af35-b753b1603c86 req-5295faa1-fb28-4d89-ad78-02c9d5e55d19 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Terminate volume connection completed successfully. Sep 17 07:26:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-227eca62-2c69-466b-af35-b753b1603c86 req-5295faa1-fb28-4d89-ad78-02c9d5e55d19 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Deleting attachment 8262117a-38bf-4ba7-ad01-c059dd6b8daf. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:26:12 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:26:20 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-615bbfa0-02d4-4b08-a314-c3c73b7f09c8 req-b97cfae5-ccdf-437d-b790-feb30638cf6e tempest-VolumesAssistedSnapshotsTest-1872827601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:26:20 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-615bbfa0-02d4-4b08-a314-c3c73b7f09c8 req-b97cfae5-ccdf-437d-b790-feb30638cf6e tempest-VolumesAssistedSnapshotsTest-1872827601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:26:20 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-615bbfa0-02d4-4b08-a314-c3c73b7f09c8 req-b97cfae5-ccdf-437d-b790-feb30638cf6e tempest-VolumesAssistedSnapshotsTest-1872827601 None] Terminate volume connection completed successfully. Sep 17 07:26:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-615bbfa0-02d4-4b08-a314-c3c73b7f09c8 req-b97cfae5-ccdf-437d-b790-feb30638cf6e tempest-VolumesAssistedSnapshotsTest-1872827601 None] Deleting attachment e2e9b299-9d83-4c76-990d-628d4df42a5e. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:26:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Acquiring lock "cinder-2c6e58ce-9fe9-4820-8a20-10d29454abfe-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:26:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Lock "cinder-2c6e58ce-9fe9-4820-8a20-10d29454abfe-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:26:22 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:26:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Acquiring lock "cinder-quobyte-2c6e58ce-9fe9-4820-8a20-10d29454abfe" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:26:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Lock "cinder-quobyte-2c6e58ce-9fe9-4820-8a20-10d29454abfe" acquired by "delete_volume" :: waited 0.028s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:26:22 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2b790e-446b-4972-a33a-f9dd894a103c]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:26:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:26:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe" returned: 0 in 0.605s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:26:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:26:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2c6e58ce-9fe9-4820-8a20-10d29454abfe" returned: 0 in 0.106s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:26:23 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Lock "cinder-quobyte-2c6e58ce-9fe9-4820-8a20-10d29454abfe" released by "delete_volume" :: held 0.973s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:26:23 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Created reservations ['1f97323b-d6c7-4a21-9642-8a31816647ed', 'dd9c4439-6032-4b94-b047-b6cfcc3a9e87', '95d531b9-61b3-460c-b0bf-70dbe5a0bca3', '00966190-d43d-4796-8b36-bea88c43c7d9'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:26:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:26:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:26:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:26:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:26:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:26:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:26:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.115s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:26:24 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:26:24 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Deleted volume successfully. Sep 17 07:26:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-870ba4b3-0e9b-43bc-b93b-2a22e0433b81 tempest-VolumesAssistedSnapshotsTest-1872827601 None] Lock "cinder-2c6e58ce-9fe9-4820-8a20-10d29454abfe-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:26:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Acquiring lock "cinder-5ab2899c-8920-4298-b2ee-efc682c3c228-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:26:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Lock "cinder-5ab2899c-8920-4298-b2ee-efc682c3c228-delete_volume" acquired by "delete_volume" :: waited 0.207s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:26:26 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:26:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:26:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:26:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:26:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:26:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:26:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:26:27 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:26:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Acquiring lock "cinder-quobyte-5ab2899c-8920-4298-b2ee-efc682c3c228" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:26:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Lock "cinder-quobyte-5ab2899c-8920-4298-b2ee-efc682c3c228" acquired by "delete_volume" :: waited 0.088s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:26:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.624s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:26:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:26:27 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[678c41d0-ab80-42d0-bc46-61d90c7a4afc]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:26:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5ab2899c-8920-4298-b2ee-efc682c3c228 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:26:29 devstack quobyte-client[83219]: System call of process 85898 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:26:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5ab2899c-8920-4298-b2ee-efc682c3c228" returned: 0 in 1.899s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:26:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5ab2899c-8920-4298-b2ee-efc682c3c228 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:26:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5ab2899c-8920-4298-b2ee-efc682c3c228" returned: 0 in 0.135s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:26:30 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Lock "cinder-quobyte-5ab2899c-8920-4298-b2ee-efc682c3c228" released by "delete_volume" :: held 2.550s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:26:30 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Created reservations ['f6947049-0fc5-436a-ad4f-b44321fa6fb1', '8236095e-36e2-4c5c-8dfb-ca25eb55f84a', '25fabe83-29f1-495a-9463-7636598e35db', '38856e3d-3978-4bd0-b7f6-4e9588d120d7'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:26:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:26:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:26:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:26:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:26:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:26:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:26:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.216s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:26:31 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:26:31 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Deleted volume successfully. Sep 17 07:26:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b71e123b-7050-411c-b43e-d99dd7695444 tempest-AttachSCSIVolumeTestJSON-1505792526 None] Lock "cinder-5ab2899c-8920-4298-b2ee-efc682c3c228-delete_volume" released by "delete_volume" :: held 5.501s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:26:41 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=23,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:26:41 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=7,cinder:INSERT=8,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:27:26 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:27:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:27:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:27:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:27:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:27:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:27:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:27:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.154s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:27:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:27:53 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:27:54 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:27:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Flow 'volume_create_manager' (5bc986cb-6811-4102-95f6-537addc11928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:27:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748e118b-c172-4f73-b385-4586e8ca8aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:27:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748e118b-c172-4f73-b385-4586e8ca8aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-359929671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c8b6a01-fb40-4661-bf75-be0e85949021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e56f50b0bc4528a6d25dd22919dc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:27:54Z,use_quota=True,user_id='8188f2a7aae04c0fb2ca1de5680c5b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:27:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48164ded-f247-482c-9abb-70f6c118c065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:27:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48164ded-f247-482c-9abb-70f6c118c065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:27:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508385d2-a529-4a5c-b87e-d1faf7cf68af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:27:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508385d2-a529-4a5c-b87e-d1faf7cf68af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c8b6a01-fb40-4661-bf75-be0e85949021', 'volume_name': 'volume-9c8b6a01-fb40-4661-bf75-be0e85949021', 'volume_size': 1, 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91606166160a47f193bac06562c1b40d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c23af952-419c-402d-9c13-65fae52513d0', 'created_at': datetime.datetime(2025, 9, 17, 5, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23af952-419c-402d-9c13-65fae52513d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:27:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d7191d-1d03-4695-8aa5-4f168e69a751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:27:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d7191d-1d03-4695-8aa5-4f168e69a751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:27:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fd5726-ac4a-4acf-9ca9-6fb334d2c695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:27:54 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Volume 9c8b6a01-fb40-4661-bf75-be0e85949021: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c8b6a01-fb40-4661-bf75-be0e85949021', 'volume_size': 1, 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91606166160a47f193bac06562c1b40d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c23af952-419c-402d-9c13-65fae52513d0', 'created_at': datetime.datetime(2025, 9, 17, 5, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23af952-419c-402d-9c13-65fae52513d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 07:27:54 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Cloning 9c8b6a01-fb40-4661-bf75-be0e85949021 from image c23af952-419c-402d-9c13-65fae52513d0 at location (None, None). {{(pid=83207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}} Sep 17 07:27:55 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_50txguskdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 17 07:27:55 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Image download 20.69 MB at 20.69 MB/s Sep 17 07:27:55 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ac8ee8-7cab-455a-973d-51f60acb5cd9]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:27:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_50txguskdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:27:56 devstack sudo[86137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_50txguskdevstack@QuobyteHD Sep 17 07:27:56 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:27:59 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root Sep 17 07:27:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_50txguskdevstack@QuobyteHD" returned: 0 in 3.358s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:27:59 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Temporary image c23af952-419c-402d-9c13-65fae52513d0 is fetched for user 8188f2a7aae04c0fb2ca1de5680c5b9e. {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 17 07:27:59 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5c5eee-d17d-42f7-b25f-b1699e1f90f8]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:27:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_50txguskdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:27:59 devstack sudo[86146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_50txguskdevstack@QuobyteHD Sep 17 07:27:59 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:28:02 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root Sep 17 07:28:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_50txguskdevstack@QuobyteHD" returned: 0 in 3.182s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:28:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:28:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-359929671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c8b6a01-fb40-4661-bf75-be0e85949021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e56f50b0bc4528a6d25dd22919dc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:27:54Z,use_quota=True,user_id='8188f2a7aae04c0fb2ca1de5680c5b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:28:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Creating volume 9c8b6a01-fb40-4661-bf75-be0e85949021 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:28:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:28:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:28:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:28:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:28:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.068s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:28:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:28:02 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:28:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:03 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=6, name=volume-9c8b6a01-fb40-4661-bf75-be0e85949021, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:28:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021 1073741824" returned: 0 in 0.875s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021" returned: 0 in 0.177s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] <== create_volume: return (1296ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:28:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:28:04 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Attempting download of c23af952-419c-402d-9c13-65fae52513d0 ((None, None)) to volume 9c8b6a01-fb40-4661-bf75-be0e85949021. {{(pid=83207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 17 07:28:04 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f6e736-6d76-45e5-a6d3-e40d25b50f18]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:28:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_kmvr3t9d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_kmvr3t9d" returned: 0 in 0.575s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_kmvr3t9d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_kmvr3t9d" returned: 1 in 0.524s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_kmvr3t9d' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:28:05 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e29a4f1-8727-4759-9609-23bffad80c8e]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:28:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_50txguskdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_50txguskdevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:06 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] c23af952-419c-402d-9c13-65fae52513d0 was qcow2, converting to raw {{(pid=83207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 17 07:28:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_50txguskdevstack@QuobyteHD /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:07 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=6, name=volume-9c8b6a01-fb40-4661-bf75-be0e85949021, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:28:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_50txguskdevstack@QuobyteHD /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021" returned: 0 in 1.427s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:08 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_50txguskdevstack@QuobyteHD, size 112.00 MB, duration 1.46 sec, destination /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021 {{(pid=83207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 07:28:08 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Converted 112.00 MB image at 76.80 MB/s Sep 17 07:28:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:08 devstack quobyte-client[83219]: System call of process 86238 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:28:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021 1G" returned: 0 in 0.174s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:08 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63d2522-cf46-4c61-9242-c04bfd7a6b78]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:28:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021" returned: 0 in 0.523s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021" returned: 1 in 0.554s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:28:09 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Downloaded image c23af952-419c-402d-9c13-65fae52513d0 ((None, None)) to volume 9c8b6a01-fb40-4661-bf75-be0e85949021 successfully. {{(pid=83207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 17 07:28:09 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Temporary image c23af952-419c-402d-9c13-65fae52513d0 for user 8188f2a7aae04c0fb2ca1de5680c5b9e is deleted. {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 17 07:28:09 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Marking volume 9c8b6a01-fb40-4661-bf75-be0e85949021 as bootable. {{(pid=83207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 17 07:28:10 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Copying metadata from image c23af952-419c-402d-9c13-65fae52513d0 to 9c8b6a01-fb40-4661-bf75-be0e85949021. {{(pid=83207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 07:28:10 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Creating volume glance metadata for volume 9c8b6a01-fb40-4661-bf75-be0e85949021 backed by image c23af952-419c-402d-9c13-65fae52513d0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 07:28:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fd5726-ac4a-4acf-9ca9-6fb334d2c695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c8b6a01-fb40-4661-bf75-be0e85949021', 'volume_size': 1, 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91606166160a47f193bac06562c1b40d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c23af952-419c-402d-9c13-65fae52513d0', 'created_at': datetime.datetime(2025, 9, 17, 5, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23af952-419c-402d-9c13-65fae52513d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bcfa4c-0f55-4332-9fa1-d1e27aab61dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-051cc31f-3d5a-494d-9215-79e106612d27 req-94db16e9-3ffa-44e7-bd9f-6d345a194bac tempest-TaggedAttachmentsTest-2119376340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:28:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-051cc31f-3d5a-494d-9215-79e106612d27 req-94db16e9-3ffa-44e7-bd9f-6d345a194bac tempest-TaggedAttachmentsTest-2119376340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:28:11 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e168ce5-d7c2-4277-a548-09962cb73507]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:28:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-051cc31f-3d5a-494d-9215-79e106612d27 req-94db16e9-3ffa-44e7-bd9f-6d345a194bac tempest-TaggedAttachmentsTest-2119376340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:12 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Volume volume-9c8b6a01-fb40-4661-bf75-be0e85949021 (9c8b6a01-fb40-4661-bf75-be0e85949021): created successfully Sep 17 07:28:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bcfa4c-0f55-4332-9fa1-d1e27aab61dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Flow 'volume_create_manager' (5bc986cb-6811-4102-95f6-537addc11928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:28:12 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5061a3c5-3011-4975-9af5-df024f31cc32 tempest-TaggedBootDevicesTest-1684484443 None] Created volume successfully. Sep 17 07:28:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-051cc31f-3d5a-494d-9215-79e106612d27 req-94db16e9-3ffa-44e7-bd9f-6d345a194bac tempest-TaggedAttachmentsTest-2119376340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452" returned: 0 in 0.606s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-051cc31f-3d5a-494d-9215-79e106612d27 req-94db16e9-3ffa-44e7-bd9f-6d345a194bac tempest-TaggedAttachmentsTest-2119376340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.644s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:28:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-051cc31f-3d5a-494d-9215-79e106612d27 req-94db16e9-3ffa-44e7-bd9f-6d345a194bac tempest-TaggedAttachmentsTest-2119376340 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4b1904d-ef3d-496f-bcc5-92d555ce6b72', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:28:12 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-051cc31f-3d5a-494d-9215-79e106612d27 req-94db16e9-3ffa-44e7-bd9f-6d345a194bac tempest-TaggedAttachmentsTest-2119376340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:28:13 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-051cc31f-3d5a-494d-9215-79e106612d27 req-94db16e9-3ffa-44e7-bd9f-6d345a194bac tempest-TaggedAttachmentsTest-2119376340 None] attachment_update completed successfully. Sep 17 07:28:13 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Flow 'volume_create_manager' (5c6ad3b6-3c41-4ff5-bdd2-6707250de979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8dd7c8-d3c1-4125-a03d-393d2f587298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8dd7c8-d3c1-4125-a03d-393d2f587298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1967269408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9385fc-f35d-479d-bcb3-589cb14bc44f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e56f50b0bc4528a6d25dd22919dc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:28:13Z,use_quota=True,user_id='8188f2a7aae04c0fb2ca1de5680c5b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05af854a-1d02-4c49-9ace-0764c1c4e0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05af854a-1d02-4c49-9ace-0764c1c4e0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9882df-0d31-42df-bf95-23cbbad5da7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9882df-0d31-42df-bf95-23cbbad5da7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c9385fc-f35d-479d-bcb3-589cb14bc44f', 'volume_name': 'volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c590fd-1278-41e1-8c7b-ac42d28b2dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c590fd-1278-41e1-8c7b-ac42d28b2dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138790ca-f485-4419-b55e-f4778cd3f632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:13 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Volume 7c9385fc-f35d-479d-bcb3-589cb14bc44f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f', 'volume_size': 1} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:28:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1967269408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9385fc-f35d-479d-bcb3-589cb14bc44f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e56f50b0bc4528a6d25dd22919dc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:28:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:28:13Z,use_quota=True,user_id='8188f2a7aae04c0fb2ca1de5680c5b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Creating volume 7c9385fc-f35d-479d-bcb3-589cb14bc44f {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:28:13 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:28:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:13 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=7, name=volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:28:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f 1073741824" returned: 0 in 0.504s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f" returned: 0 in 0.131s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] <== create_volume: return (726ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:28:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:28:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138790ca-f485-4419-b55e-f4778cd3f632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9f6e65-10ab-44dc-be90-4927c44e4112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:14 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Volume volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f (7c9385fc-f35d-479d-bcb3-589cb14bc44f): created successfully Sep 17 07:28:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9f6e65-10ab-44dc-be90-4927c44e4112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Flow 'volume_create_manager' (5c6ad3b6-3c41-4ff5-bdd2-6707250de979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:28:14 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-fa0b3d51-1b15-4dc4-b4d2-e59109f44ee0 tempest-TaggedBootDevicesTest-1684484443 None] Created volume successfully. Sep 17 07:28:16 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Flow 'volume_create_manager' (ddefcf21-2717-41c6-8889-212570231fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3be185-06b1-48c7-b01f-e2689d122752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3be185-06b1-48c7-b01f-e2689d122752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1859612390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86348a0-069b-476a-9a05-848ba728ec40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e56f50b0bc4528a6d25dd22919dc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:28:16Z,use_quota=True,user_id='8188f2a7aae04c0fb2ca1de5680c5b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3fc1d2-aa3c-4286-b5e1-87fbe2e1805d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3fc1d2-aa3c-4286-b5e1-87fbe2e1805d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc181f7-edf9-4f98-9536-37a2315eaaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc181f7-edf9-4f98-9536-37a2315eaaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b86348a0-069b-476a-9a05-848ba728ec40', 'volume_name': 'volume-b86348a0-069b-476a-9a05-848ba728ec40', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b5b4bc2-e576-451d-b9ce-d79fc4572b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b5b4bc2-e576-451d-b9ce-d79fc4572b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38960cf5-26b7-403e-a945-c487892fa07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:16 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Volume b86348a0-069b-476a-9a05-848ba728ec40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b86348a0-069b-476a-9a05-848ba728ec40', 'volume_size': 1} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1859612390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86348a0-069b-476a-9a05-848ba728ec40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e56f50b0bc4528a6d25dd22919dc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:28:16Z,use_quota=True,user_id='8188f2a7aae04c0fb2ca1de5680c5b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Creating volume b86348a0-069b-476a-9a05-848ba728ec40 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:28:16 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b86348a0-069b-476a-9a05-848ba728ec40 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:16 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=8, name=volume-b86348a0-069b-476a-9a05-848ba728ec40, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b86348a0-069b-476a-9a05-848ba728ec40 1073741824" returned: 0 in 0.348s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b86348a0-069b-476a-9a05-848ba728ec40 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b86348a0-069b-476a-9a05-848ba728ec40" returned: 0 in 0.087s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] <== create_volume: return (497ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:28:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.508s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:28:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38960cf5-26b7-403e-a945-c487892fa07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86348a0-069b-476a-9a05-848ba728ec40', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda330e9-b350-48cb-aefb-61170f5d14c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:17 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Volume volume-b86348a0-069b-476a-9a05-848ba728ec40 (b86348a0-069b-476a-9a05-848ba728ec40): created successfully Sep 17 07:28:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda330e9-b350-48cb-aefb-61170f5d14c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Flow 'volume_create_manager' (ddefcf21-2717-41c6-8889-212570231fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:28:17 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-032cdc0b-b16d-4b39-9746-d547bdedac0c tempest-TaggedBootDevicesTest-1684484443 None] Created volume successfully. Sep 17 07:28:26 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:28:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:28:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:28:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:28:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:28:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:28:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.110s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:28:27 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=18,cinder:UPDATE=8,cinder:INSERT=9 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:28:27 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=11,cinder:SELECT=15,cinder:INSERT=4,cinder:DELETE=3 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:28:41 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:28:41 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:28:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Flow 'volume_create_manager' (74c8a731-067f-4ab3-99d3-ce7137095838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:28:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32122aa-9a0f-44d7-89a1-384241fac30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32122aa-9a0f-44d7-89a1-384241fac30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-96325043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce7f81c-afb1-4568-ac9d-984345c3f8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a785f9ef9a1c4434a1c18c7b60b09c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:28:41Z,use_quota=True,user_id='a2db021298ef40e197cbdc01b093d168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48abae47-5f3f-4851-90d2-7bb14b18e326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48abae47-5f3f-4851-90d2-7bb14b18e326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17116e0a-b0ca-4c95-a8c8-2d642c277514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17116e0a-b0ca-4c95-a8c8-2d642c277514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce7f81c-afb1-4568-ac9d-984345c3f8a8', 'volume_name': 'volume-dce7f81c-afb1-4568-ac9d-984345c3f8a8', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d4d874-d2a7-4f25-a2a9-f61e32f34331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d4d874-d2a7-4f25-a2a9-f61e32f34331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315725b8-77a4-4eb1-865d-8166fbdfdcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:42 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Volume dce7f81c-afb1-4568-ac9d-984345c3f8a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce7f81c-afb1-4568-ac9d-984345c3f8a8', 'volume_size': 1} Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-96325043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce7f81c-afb1-4568-ac9d-984345c3f8a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a785f9ef9a1c4434a1c18c7b60b09c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:28:41Z,use_quota=True,user_id='a2db021298ef40e197cbdc01b093d168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Creating volume dce7f81c-afb1-4568-ac9d-984345c3f8a8 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:28:42 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-dce7f81c-afb1-4568-ac9d-984345c3f8a8 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:42 devstack quobyte-client[83219]: System call of process 86828 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:28:42 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=9, name=volume-dce7f81c-afb1-4568-ac9d-984345c3f8a8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-dce7f81c-afb1-4568-ac9d-984345c3f8a8 1073741824" returned: 0 in 0.480s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-dce7f81c-afb1-4568-ac9d-984345c3f8a8 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-dce7f81c-afb1-4568-ac9d-984345c3f8a8" returned: 0 in 0.211s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] <== create_volume: return (828ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:28:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:28:44 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-001c30d5-00b1-40f8-8249-6643ce228d9e req-c5b7e4e7-ac9a-4c8c-9aa8-3f49c4e6cb11 tempest-TaggedAttachmentsTest-2119376340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:28:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315725b8-77a4-4eb1-865d-8166fbdfdcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce7f81c-afb1-4568-ac9d-984345c3f8a8', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d197cee7-3a86-4d0d-bbe0-2290004f454f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:28:44 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-001c30d5-00b1-40f8-8249-6643ce228d9e req-c5b7e4e7-ac9a-4c8c-9aa8-3f49c4e6cb11 tempest-TaggedAttachmentsTest-2119376340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:28:44 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-001c30d5-00b1-40f8-8249-6643ce228d9e req-c5b7e4e7-ac9a-4c8c-9aa8-3f49c4e6cb11 tempest-TaggedAttachmentsTest-2119376340 None] Terminate volume connection completed successfully. Sep 17 07:28:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-001c30d5-00b1-40f8-8249-6643ce228d9e req-c5b7e4e7-ac9a-4c8c-9aa8-3f49c4e6cb11 tempest-TaggedAttachmentsTest-2119376340 None] Deleting attachment d4b1904d-ef3d-496f-bcc5-92d555ce6b72. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:28:44 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Volume volume-dce7f81c-afb1-4568-ac9d-984345c3f8a8 (dce7f81c-afb1-4568-ac9d-984345c3f8a8): created successfully Sep 17 07:28:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d197cee7-3a86-4d0d-bbe0-2290004f454f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:28:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Flow 'volume_create_manager' (74c8a731-067f-4ab3-99d3-ce7137095838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:28:44 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-6d038460-1378-49fc-9c47-52f1d65b611f tempest-VolumesAdminNegativeTest-1885230613 None] Created volume successfully. Sep 17 07:28:45 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Acquiring lock "cinder-dce7f81c-afb1-4568-ac9d-984345c3f8a8-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:28:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-0239f06a-5503-4436-af85-f3c34510604e req-1d4cc468-7dd9-4e30-addf-407d85e4250d tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:28:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-0239f06a-5503-4436-af85-f3c34510604e req-1d4cc468-7dd9-4e30-addf-407d85e4250d tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:28:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Lock "cinder-dce7f81c-afb1-4568-ac9d-984345c3f8a8-delete_volume" acquired by "delete_volume" :: waited 0.626s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:28:46 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9a8d4f-c255-4478-a0eb-9877ff8aab46]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:28:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-0239f06a-5503-4436-af85-f3c34510604e req-1d4cc468-7dd9-4e30-addf-407d85e4250d tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:47 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:28:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Acquiring lock "cinder-quobyte-dce7f81c-afb1-4568-ac9d-984345c3f8a8" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:28:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Lock "cinder-quobyte-dce7f81c-afb1-4568-ac9d-984345c3f8a8" acquired by "delete_volume" :: waited 0.197s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:28:48 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd6a13d-4fea-4efd-af82-b25aa6bd3911]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:28:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-dce7f81c-afb1-4568-ac9d-984345c3f8a8 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-0239f06a-5503-4436-af85-f3c34510604e req-1d4cc468-7dd9-4e30-addf-407d85e4250d tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021" returned: 0 in 1.858s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-0239f06a-5503-4436-af85-f3c34510604e req-1d4cc468-7dd9-4e30-addf-407d85e4250d tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:51 devstack quobyte-client[83219]: System call of process 86848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:28:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-0239f06a-5503-4436-af85-f3c34510604e req-1d4cc468-7dd9-4e30-addf-407d85e4250d tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021" returned: 1 in 2.756s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:51 devstack quobyte-client[83219]: System call of process 86846 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:28:51 devstack quobyte-client[83219]: System call of process 86846 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:28:51 devstack quobyte-client[83219]: System call of process 86846 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:28:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-0239f06a-5503-4436-af85-f3c34510604e req-1d4cc468-7dd9-4e30-addf-407d85e4250d tempest-TaggedBootDevicesTest-1684484443 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:28:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-0239f06a-5503-4436-af85-f3c34510604e req-1d4cc468-7dd9-4e30-addf-407d85e4250d tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 5.351s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:28:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-dce7f81c-afb1-4568-ac9d-984345c3f8a8" returned: 0 in 4.268s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-dce7f81c-afb1-4568-ac9d-984345c3f8a8 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-dce7f81c-afb1-4568-ac9d-984345c3f8a8" returned: 0 in 1.260s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-0239f06a-5503-4436-af85-f3c34510604e req-1d4cc468-7dd9-4e30-addf-407d85e4250d tempest-TaggedBootDevicesTest-1684484443 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-9c8b6a01-fb40-4661-bf75-be0e85949021', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24378a63-5eb9-4cf5-bf64-c6e5f6d6c3b3', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:28:54 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-0239f06a-5503-4436-af85-f3c34510604e req-1d4cc468-7dd9-4e30-addf-407d85e4250d tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:28:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Lock "cinder-quobyte-dce7f81c-afb1-4568-ac9d-984345c3f8a8" released by "delete_volume" :: held 6.208s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:28:55 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Created reservations ['b2061de1-6b9f-4f8b-812f-9056412d0a58', '2815a40e-1766-46eb-8823-240efcefe496', '6849c65c-21f2-4bf1-8a2b-7af5a4f82c9c', 'f9a878eb-0269-4f34-9a65-900231fe39f4'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:28:55 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-0239f06a-5503-4436-af85-f3c34510604e req-1d4cc468-7dd9-4e30-addf-407d85e4250d tempest-TaggedBootDevicesTest-1684484443 None] attachment_update completed successfully. Sep 17 07:28:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:28:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:28:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:28:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:28:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.094s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:28:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:28:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.585s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:28:57 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:28:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Deleted volume successfully. Sep 17 07:28:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-56b11477-d763-4a2a-b536-aa1f636a12d0 tempest-VolumesAdminNegativeTest-1885230613 None] Lock "cinder-dce7f81c-afb1-4568-ac9d-984345c3f8a8-delete_volume" released by "delete_volume" :: held 11.914s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:29:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-0239f06a-5503-4436-af85-f3c34510604e req-c82917d8-b7d1-495a-a455-4d047e7f7fef tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:29:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-0239f06a-5503-4436-af85-f3c34510604e req-c82917d8-b7d1-495a-a455-4d047e7f7fef tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.019s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:29:03 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa838c8b-7d3e-4472-8c09-7621163729a7]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:29:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-0239f06a-5503-4436-af85-f3c34510604e req-c82917d8-b7d1-495a-a455-4d047e7f7fef tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-0239f06a-5503-4436-af85-f3c34510604e req-c82917d8-b7d1-495a-a455-4d047e7f7fef tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f" returned: 0 in 1.242s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-0239f06a-5503-4436-af85-f3c34510604e req-c82917d8-b7d1-495a-a455-4d047e7f7fef tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.320s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:29:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-0239f06a-5503-4436-af85-f3c34510604e req-c82917d8-b7d1-495a-a455-4d047e7f7fef tempest-TaggedBootDevicesTest-1684484443 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3135b8c8-ff8c-4374-9d25-926c279e9ed8', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:29:04 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-0239f06a-5503-4436-af85-f3c34510604e req-c82917d8-b7d1-495a-a455-4d047e7f7fef tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:29:05 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-0239f06a-5503-4436-af85-f3c34510604e req-c82917d8-b7d1-495a-a455-4d047e7f7fef tempest-TaggedBootDevicesTest-1684484443 None] attachment_update completed successfully. Sep 17 07:29:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-0239f06a-5503-4436-af85-f3c34510604e req-47a7cb7b-77ce-4117-8bff-5f5ab376bd91 tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:29:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-0239f06a-5503-4436-af85-f3c34510604e req-47a7cb7b-77ce-4117-8bff-5f5ab376bd91 tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:29:08 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12f78f2-5e0c-4e7a-bbeb-b88920e57336]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:29:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-0239f06a-5503-4436-af85-f3c34510604e req-47a7cb7b-77ce-4117-8bff-5f5ab376bd91 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b86348a0-069b-476a-9a05-848ba728ec40 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-0239f06a-5503-4436-af85-f3c34510604e req-47a7cb7b-77ce-4117-8bff-5f5ab376bd91 tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b86348a0-069b-476a-9a05-848ba728ec40" returned: 0 in 0.550s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-0239f06a-5503-4436-af85-f3c34510604e req-47a7cb7b-77ce-4117-8bff-5f5ab376bd91 tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.618s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:29:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-0239f06a-5503-4436-af85-f3c34510604e req-47a7cb7b-77ce-4117-8bff-5f5ab376bd91 tempest-TaggedBootDevicesTest-1684484443 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-b86348a0-069b-476a-9a05-848ba728ec40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '631cd67a-c588-4bfe-8397-d67083bdab98', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:29:09 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-0239f06a-5503-4436-af85-f3c34510604e req-47a7cb7b-77ce-4117-8bff-5f5ab376bd91 tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:29:09 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-0239f06a-5503-4436-af85-f3c34510604e req-47a7cb7b-77ce-4117-8bff-5f5ab376bd91 tempest-TaggedBootDevicesTest-1684484443 None] attachment_update completed successfully. Sep 17 07:29:19 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=25,cinder:UPDATE=17,cinder:INSERT=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:29:19 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=12,cinder:SELECT=22,cinder:DELETE=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:29:26 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:29:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:29:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:29:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:29:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:29:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:29:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.239s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:29:35 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Acquiring lock "cinder-5b92f26f-9f2b-4972-b1d7-28d964ce3452-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:29:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Lock "cinder-5b92f26f-9f2b-4972-b1d7-28d964ce3452-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:29:36 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:29:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Acquiring lock "cinder-quobyte-5b92f26f-9f2b-4972-b1d7-28d964ce3452" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:29:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Lock "cinder-quobyte-5b92f26f-9f2b-4972-b1d7-28d964ce3452" acquired by "delete_volume" :: waited 0.022s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:29:36 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4545afd7-3791-4faf-9495-94f7b2255207]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:29:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452" returned: 0 in 0.524s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b92f26f-9f2b-4972-b1d7-28d964ce3452" returned: 0 in 0.148s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:37 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Lock "cinder-quobyte-5b92f26f-9f2b-4972-b1d7-28d964ce3452" released by "delete_volume" :: held 0.993s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:29:37 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Created reservations ['998214bd-4673-4241-b692-3851cab19b27', 'c4fb5861-566f-4137-b3f8-1b9fc1ebec6a', '281b09a3-f0ff-4327-b8e7-46166dece08e', '859cb8e4-0d91-405c-8dc0-384b7c1f914c'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:29:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:29:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:29:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:29:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:29:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:29:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.177s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:38 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:29:38 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Deleted volume successfully. Sep 17 07:29:38 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b529f875-722c-4d1a-b4d5-bf5fc93680ad tempest-TaggedAttachmentsTest-2119376340 None] Lock "cinder-5b92f26f-9f2b-4972-b1d7-28d964ce3452-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:29:42 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:29:42 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Flow 'volume_create_manager' (f415bd9e-b446-4f49-b9e5-256baf4be59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de28842d-882b-431f-a42e-1c6796321c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de28842d-882b-431f-a42e-1c6796321c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1890727283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c923dc3-feab-4e41-94ef-d7ed9f22decf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910570221fcc46678d4baa657127e1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:29:43Z,use_quota=True,user_id='1713531bc7c14b9eaf36910b6df1fcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad3b15c-cccd-4b95-a767-19c09b105257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad3b15c-cccd-4b95-a767-19c09b105257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59dc420b-bf8c-409e-8e2c-7f83dcc9477c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59dc420b-bf8c-409e-8e2c-7f83dcc9477c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c923dc3-feab-4e41-94ef-d7ed9f22decf', 'volume_name': 'volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3346eca-1fb4-473e-8557-3a3c6637237e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3346eca-1fb4-473e-8557-3a3c6637237e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1cb305-24d9-4e47-a26c-8bbc541acc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:29:43 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Volume 0c923dc3-feab-4e41-94ef-d7ed9f22decf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf', 'volume_size': 1} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1890727283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c923dc3-feab-4e41-94ef-d7ed9f22decf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910570221fcc46678d4baa657127e1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:29:43Z,use_quota=True,user_id='1713531bc7c14b9eaf36910b6df1fcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Creating volume 0c923dc3-feab-4e41-94ef-d7ed9f22decf {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:29:43 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:29:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:43 devstack quobyte-client[83219]: System call of process 87605 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:29:43 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=10, name=volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:29:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf 1073741824" returned: 0 in 0.634s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf" returned: 0 in 0.168s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:44 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] <== create_volume: return (916ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:29:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:29:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1cb305-24d9-4e47-a26c-8bbc541acc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:29:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19eba94-b577-4adc-b718-5a4fc7a487a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:29:45 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Volume volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf (0c923dc3-feab-4e41-94ef-d7ed9f22decf): created successfully Sep 17 07:29:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19eba94-b577-4adc-b718-5a4fc7a487a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:29:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Flow 'volume_create_manager' (f415bd9e-b446-4f49-b9e5-256baf4be59c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:29:45 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-82aac424-f700-4dbc-b97e-cfaacbc58c1c req-f9c2c6ea-47b9-4d79-a53c-4eb9c549aae7 tempest-VolumesSnapshotsTestJSON-544082543 None] Created volume successfully. Sep 17 07:29:49 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:29:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:29:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:29:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] Creating offline snapshot 169fc5ea-7a4a-4914-acc7-c161a3838dbf of volume 0c923dc3-feab-4e41-94ef-d7ed9f22decf {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:29:49 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[18abbbf4-88e5-4071-9326-a14d4b37b498]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:29:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf" returned: 0 in 2.064s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:52 devstack quobyte-client[83219]: System call of process 87820 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:29:52 devstack quobyte-client[83219]: System call of process 87820 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:29:52 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=11, name=volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:29:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf 1G" returned: 0 in 0.687s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "qemu-img rebase -u -b volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf" returned: 0 in 0.679s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:53 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:29:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf" returned: 0 in 0.460s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:29:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf" returned: 0 in 0.333s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.info" returned: 0 in 0.713s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:55 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:29:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:29:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.info" returned: 0 in 1.016s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:29:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.509s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:29:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-e8abb92e-9ed2-411f-8d55-a5f07da91b43 req-344ec7f8-c2c6-40a0-9e79-49ee344c8639 tempest-VolumesSnapshotsTestJSON-544082543 None] Create snapshot completed successfully Sep 17 07:29:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Acquiring lock "cinder-169fc5ea-7a4a-4914-acc7-c161a3838dbf-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:29:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "cinder-169fc5ea-7a4a-4914-acc7-c161a3838dbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.251s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:29:58 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:29:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Acquiring lock "cinder-quobyte-0c923dc3-feab-4e41-94ef-d7ed9f22decf" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:29:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "cinder-quobyte-0c923dc3-feab-4e41-94ef-d7ed9f22decf" acquired by "delete_snapshot" :: waited 0.074s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:29:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Acquiring lock "cinder-quobyte-169fc5ea-7a4a-4914-acc7-c161a3838dbf" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:29:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "cinder-quobyte-169fc5ea-7a4a-4914-acc7-c161a3838dbf" acquired by "_delete_snapshot" :: waited 0.075s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:29:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Deleting offline snapshot 169fc5ea-7a4a-4914-acc7-c161a3838dbf of volume 0c923dc3-feab-4e41-94ef-d7ed9f22decf {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:29:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] snapshot_file for this snap is: volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:29:59 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[279bedae-0c6d-4807-ad72-c4f1e2cad161]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:29:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:00 devstack quobyte-client[83219]: System call of process 87906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:30:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf" returned: 0 in 1.297s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:00 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:30:00 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a05e0a-4093-4a43-ad4c-c43fdf66b86d]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:30:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf" returned: 0 in 1.103s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf" returned: 0 in 0.576s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf.169fc5ea-7a4a-4914-acc7-c161a3838dbf" returned: 0 in 0.347s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:03 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "cinder-quobyte-169fc5ea-7a4a-4914-acc7-c161a3838dbf" released by "_delete_snapshot" :: held 4.600s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:30:03 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "cinder-quobyte-0c923dc3-feab-4e41-94ef-d7ed9f22decf" released by "delete_snapshot" :: held 4.706s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:30:03 devstack cinder-volume[83207]: WARNING cinder.quota [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:30:04 devstack cinder-volume[83207]: DEBUG cinder.quota [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Created reservations ['1aa852f6-53a2-4913-8dc9-cd1565eab2b6', '6268fb8e-41e4-4733-9305-80465c4347b8', '4a385f60-f52d-4f4c-b5a0-4d65b06b4cd1', 'f4a28821-31e7-400c-a616-b95606eef289'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:04 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Delete snapshot completed successfully. Sep 17 07:30:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-163ac74a-fd2d-44b7-93b3-a0c84b770328 req-40e8b6b5-acb5-4636-a348-1ae2d21af199 tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "cinder-169fc5ea-7a4a-4914-acc7-c161a3838dbf-delete_snapshot" released by "delete_snapshot" :: held 5.537s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:30:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Acquiring lock "cinder-0c923dc3-feab-4e41-94ef-d7ed9f22decf-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:30:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "cinder-0c923dc3-feab-4e41-94ef-d7ed9f22decf-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:30:05 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:30:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Acquiring lock "cinder-quobyte-0c923dc3-feab-4e41-94ef-d7ed9f22decf" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:30:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "cinder-quobyte-0c923dc3-feab-4e41-94ef-d7ed9f22decf" acquired by "delete_volume" :: waited 0.033s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:30:05 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fea5fcb-d442-42fb-88fc-85a4a50425b1]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:30:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf" returned: 0 in 0.748s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0c923dc3-feab-4e41-94ef-d7ed9f22decf" returned: 0 in 0.163s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:06 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "cinder-quobyte-0c923dc3-feab-4e41-94ef-d7ed9f22decf" released by "delete_volume" :: held 1.224s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:30:06 devstack cinder-volume[83207]: DEBUG cinder.quota [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Created reservations ['00721a73-c5a1-44f7-b9d5-e1820e967b9f', '383243fb-67c7-488c-ac00-d6706aa6e8c8', 'eded9c1d-667c-4ced-a65c-74c0329f2189', '91abab9d-aa87-454a-80ba-f94b83cff4db'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:30:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:30:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:30:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:30:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:30:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.278s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:07 devstack cinder-volume[83207]: DEBUG cinder.manager [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:30:07 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Deleted volume successfully. Sep 17 07:30:07 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-acf5df2b-29c3-4bc6-94cd-c37aa51e3069 req-f46e0028-a557-45b9-a43e-918ec10bfb2f tempest-VolumesSnapshotsTestJSON-544082543 None] Lock "cinder-0c923dc3-feab-4e41-94ef-d7ed9f22decf-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:30:17 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=27,cinder:SELECT=16,cinder:INSERT=8,cinder:DELETE=3 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:30:17 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:30:17 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Flow 'volume_create_manager' (df389dfa-d94a-4632-88f6-49bacdf7d77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f1deeb-40bb-424d-a788-a06e6a144431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f1deeb-40bb-424d-a788-a06e6a144431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1596112169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f3c3b3-1db0-43b0-8ee6-d185056d7051,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='932ae86e655e4c19b45823c4059c1691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:30:17Z,use_quota=True,user_id='3718fc7de5114f58985c78a4397f5aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2920e78-f539-4e82-9597-7e1898450852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2920e78-f539-4e82-9597-7e1898450852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b44de93-e25f-4ee2-9ea4-c77d159825b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b44de93-e25f-4ee2-9ea4-c77d159825b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91f3c3b3-1db0-43b0-8ee6-d185056d7051', 'volume_name': 'volume-91f3c3b3-1db0-43b0-8ee6-d185056d7051', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1d33fc-adb3-43cd-97c3-0ee204d0aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1d33fc-adb3-43cd-97c3-0ee204d0aeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863e4f16-9140-4ad9-b62b-399588f8aeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:18 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Volume 91f3c3b3-1db0-43b0-8ee6-d185056d7051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91f3c3b3-1db0-43b0-8ee6-d185056d7051', 'volume_size': 1} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1596112169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f3c3b3-1db0-43b0-8ee6-d185056d7051,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='932ae86e655e4c19b45823c4059c1691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:30:17Z,use_quota=True,user_id='3718fc7de5114f58985c78a4397f5aa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Creating volume 91f3c3b3-1db0-43b0-8ee6-d185056d7051 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:30:18 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:30:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91f3c3b3-1db0-43b0-8ee6-d185056d7051 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:18 devstack quobyte-client[83219]: System call of process 88002 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:30:18 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=13, name=volume-91f3c3b3-1db0-43b0-8ee6-d185056d7051, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:30:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91f3c3b3-1db0-43b0-8ee6-d185056d7051 1073741824" returned: 0 in 0.800s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91f3c3b3-1db0-43b0-8ee6-d185056d7051 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91f3c3b3-1db0-43b0-8ee6-d185056d7051" returned: 0 in 0.370s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:19 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] <== create_volume: return (1328ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:30:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:30:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863e4f16-9140-4ad9-b62b-399588f8aeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91f3c3b3-1db0-43b0-8ee6-d185056d7051', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507cd966-0db7-4941-b9fa-319c31c7837b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:20 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Volume volume-91f3c3b3-1db0-43b0-8ee6-d185056d7051 (91f3c3b3-1db0-43b0-8ee6-d185056d7051): created successfully Sep 17 07:30:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507cd966-0db7-4941-b9fa-319c31c7837b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Flow 'volume_create_manager' (df389dfa-d94a-4632-88f6-49bacdf7d77a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:30:20 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-785f4e7a-6ede-41c7-90a1-44830a32214c req-8230b4ee-b0ce-425f-bfd0-a3f6165f5644 tempest-VolumesGetTestJSON-985600094 None] Created volume successfully. Sep 17 07:30:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Acquiring lock "cinder-91f3c3b3-1db0-43b0-8ee6-d185056d7051-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:30:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Lock "cinder-91f3c3b3-1db0-43b0-8ee6-d185056d7051-delete_volume" acquired by "delete_volume" :: waited 0.259s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:30:22 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:30:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Acquiring lock "cinder-quobyte-91f3c3b3-1db0-43b0-8ee6-d185056d7051" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:30:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Lock "cinder-quobyte-91f3c3b3-1db0-43b0-8ee6-d185056d7051" acquired by "delete_volume" :: waited 0.023s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:30:22 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b3014c-7750-4276-882c-bfaef4b50833]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:30:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91f3c3b3-1db0-43b0-8ee6-d185056d7051 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:23 devstack quobyte-client[83219]: System call of process 88015 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:30:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91f3c3b3-1db0-43b0-8ee6-d185056d7051" returned: 0 in 1.325s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91f3c3b3-1db0-43b0-8ee6-d185056d7051 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91f3c3b3-1db0-43b0-8ee6-d185056d7051" returned: 0 in 0.177s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Lock "cinder-quobyte-91f3c3b3-1db0-43b0-8ee6-d185056d7051" released by "delete_volume" :: held 1.985s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:30:25 devstack cinder-volume[83207]: DEBUG cinder.quota [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Created reservations ['ffeaa4d4-84c9-4ee1-95d4-40a34811a86d', '62113f6a-e4d5-46e8-9284-3abad01b7f12', '1f37e5fc-d264-4528-b3ad-a743e7fba5db', 'd0f4ee94-a4a6-47e6-a04c-e9d7246ea8d1'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:30:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:30:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:30:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:30:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:30:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.394s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:26 devstack cinder-volume[83207]: DEBUG cinder.manager [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:30:26 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Deleted volume successfully. Sep 17 07:30:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:30:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:30:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:30:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:30:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:30:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.068s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:30:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.667s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:30:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-008f1b21-1a05-4022-aa1d-0ea970b425c6 req-a14aef2b-1e08-4221-a9bd-4659089c0808 tempest-VolumesGetTestJSON-985600094 None] Lock "cinder-91f3c3b3-1db0-43b0-8ee6-d185056d7051-delete_volume" released by "delete_volume" :: held 6.383s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=23,cinder:UPDATE=38,cinder:INSERT=4,cinder:DELETE=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:30:35 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Flow 'volume_create_manager' (98867dff-976a-4b7c-be83-e85843863433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4542addc-1871-4c82-bf69-56a5344bb0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4542addc-1871-4c82-bf69-56a5344bb0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1310783041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6c9ebc-9060-4bba-be6f-6892bb48ff40,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='374d7c964f71423182a256aa3a0049e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:30:35Z,use_quota=True,user_id='0b9e0e4de4244af99c0f1915a33fc361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8aee015-a5f0-4a20-8c8f-b90ac6982a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8aee015-a5f0-4a20-8c8f-b90ac6982a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4892a3-d35d-43a3-ac1a-e99269c65bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4892a3-d35d-43a3-ac1a-e99269c65bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc6c9ebc-9060-4bba-be6f-6892bb48ff40', 'volume_name': 'volume-bc6c9ebc-9060-4bba-be6f-6892bb48ff40', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4523306b-f30a-4fb1-aa84-fe60b3875b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4523306b-f30a-4fb1-aa84-fe60b3875b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ae6cbd-9576-4e3d-86a5-c9452b9c325a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:35 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Volume bc6c9ebc-9060-4bba-be6f-6892bb48ff40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc6c9ebc-9060-4bba-be6f-6892bb48ff40', 'volume_size': 1} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1310783041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6c9ebc-9060-4bba-be6f-6892bb48ff40,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='374d7c964f71423182a256aa3a0049e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:30:35Z,use_quota=True,user_id='0b9e0e4de4244af99c0f1915a33fc361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Creating volume bc6c9ebc-9060-4bba-be6f-6892bb48ff40 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:30:35 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:30:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bc6c9ebc-9060-4bba-be6f-6892bb48ff40 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:35 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=14, name=volume-bc6c9ebc-9060-4bba-be6f-6892bb48ff40, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:30:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bc6c9ebc-9060-4bba-be6f-6892bb48ff40 1073741824" returned: 0 in 0.677s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bc6c9ebc-9060-4bba-be6f-6892bb48ff40 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bc6c9ebc-9060-4bba-be6f-6892bb48ff40" returned: 0 in 0.209s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] <== create_volume: return (976ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:30:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:30:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ae6cbd-9576-4e3d-86a5-c9452b9c325a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6c9ebc-9060-4bba-be6f-6892bb48ff40', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b037391-80be-4d18-add4-6da4e2e27fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:36 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Volume volume-bc6c9ebc-9060-4bba-be6f-6892bb48ff40 (bc6c9ebc-9060-4bba-be6f-6892bb48ff40): created successfully Sep 17 07:30:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b037391-80be-4d18-add4-6da4e2e27fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Flow 'volume_create_manager' (98867dff-976a-4b7c-be83-e85843863433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:30:36 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-7366dd48-4b9a-40bd-bc2d-d0af2792a830 tempest-VolumesTestJSON-1654112816 None] Created volume successfully. Sep 17 07:30:37 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Flow 'volume_create_manager' (8930e221-7cce-484e-9b49-3c80aea1c561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59c1d3c-485a-482d-a6b2-ae3b4b8d6db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59c1d3c-485a-482d-a6b2-ae3b4b8d6db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1583577418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a336a5-7bdf-4ac5-906b-255edb6ac3de,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='374d7c964f71423182a256aa3a0049e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:30:38Z,use_quota=True,user_id='0b9e0e4de4244af99c0f1915a33fc361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e467185e-cc80-40e7-ae93-3d23849ff3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e467185e-cc80-40e7-ae93-3d23849ff3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dcf34df-9b2c-4db1-868a-dd8534af39cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dcf34df-9b2c-4db1-868a-dd8534af39cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a336a5-7bdf-4ac5-906b-255edb6ac3de', 'volume_name': 'volume-d4a336a5-7bdf-4ac5-906b-255edb6ac3de', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4739df-aa6b-46c5-b064-4e130444de1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4739df-aa6b-46c5-b064-4e130444de1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6f9617-5a8f-4157-b027-9d52df50dfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:38 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Volume d4a336a5-7bdf-4ac5-906b-255edb6ac3de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a336a5-7bdf-4ac5-906b-255edb6ac3de', 'volume_size': 1} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1583577418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a336a5-7bdf-4ac5-906b-255edb6ac3de,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='374d7c964f71423182a256aa3a0049e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:30:38Z,use_quota=True,user_id='0b9e0e4de4244af99c0f1915a33fc361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Creating volume d4a336a5-7bdf-4ac5-906b-255edb6ac3de {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:30:38 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d4a336a5-7bdf-4ac5-906b-255edb6ac3de 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:38 devstack quobyte-client[83219]: System call of process 88035 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:30:38 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=15, name=volume-d4a336a5-7bdf-4ac5-906b-255edb6ac3de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d4a336a5-7bdf-4ac5-906b-255edb6ac3de 1073741824" returned: 0 in 0.527s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d4a336a5-7bdf-4ac5-906b-255edb6ac3de {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d4a336a5-7bdf-4ac5-906b-255edb6ac3de" returned: 0 in 0.201s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] <== create_volume: return (840ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:30:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:30:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6f9617-5a8f-4157-b027-9d52df50dfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a336a5-7bdf-4ac5-906b-255edb6ac3de', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23325d22-25cd-44c1-971d-016316c15a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:39 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Volume volume-d4a336a5-7bdf-4ac5-906b-255edb6ac3de (d4a336a5-7bdf-4ac5-906b-255edb6ac3de): created successfully Sep 17 07:30:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23325d22-25cd-44c1-971d-016316c15a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Flow 'volume_create_manager' (8930e221-7cce-484e-9b49-3c80aea1c561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:30:39 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-f99c1cd7-612a-4164-9fde-83c8daeb9b21 tempest-VolumesTestJSON-1654112816 None] Created volume successfully. Sep 17 07:30:42 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Flow 'volume_create_manager' (f2b247b2-f243-4b95-b55f-3761b3b270c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d859db78-ead6-4e0b-9765-19187b001c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d859db78-ead6-4e0b-9765-19187b001c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1133461417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38af3e05-ba59-4a38-ad1e-c9e27cb43da4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='374d7c964f71423182a256aa3a0049e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:30:42Z,use_quota=True,user_id='0b9e0e4de4244af99c0f1915a33fc361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a586bd-b65a-4dc6-8c02-4b9897d35709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a586bd-b65a-4dc6-8c02-4b9897d35709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777398cd-838b-4d19-b060-5ed4726a0afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777398cd-838b-4d19-b060-5ed4726a0afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38af3e05-ba59-4a38-ad1e-c9e27cb43da4', 'volume_name': 'volume-38af3e05-ba59-4a38-ad1e-c9e27cb43da4', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8256151b-f8c1-4fcf-a62a-62efff87e283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8256151b-f8c1-4fcf-a62a-62efff87e283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac1ec33-8878-44ac-967c-5fdd54c2f518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:42 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Volume 38af3e05-ba59-4a38-ad1e-c9e27cb43da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38af3e05-ba59-4a38-ad1e-c9e27cb43da4', 'volume_size': 1} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1133461417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38af3e05-ba59-4a38-ad1e-c9e27cb43da4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='374d7c964f71423182a256aa3a0049e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:30:42Z,use_quota=True,user_id='0b9e0e4de4244af99c0f1915a33fc361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Creating volume 38af3e05-ba59-4a38-ad1e-c9e27cb43da4 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:30:42 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:30:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-38af3e05-ba59-4a38-ad1e-c9e27cb43da4 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:42 devstack quobyte-client[83219]: System call of process 88072 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:30:42 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=16, name=volume-38af3e05-ba59-4a38-ad1e-c9e27cb43da4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:30:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-38af3e05-ba59-4a38-ad1e-c9e27cb43da4 1073741824" returned: 0 in 0.544s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-38af3e05-ba59-4a38-ad1e-c9e27cb43da4 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-38af3e05-ba59-4a38-ad1e-c9e27cb43da4" returned: 0 in 0.250s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] <== create_volume: return (948ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:30:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:30:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac1ec33-8878-44ac-967c-5fdd54c2f518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38af3e05-ba59-4a38-ad1e-c9e27cb43da4', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec358dea-1bbf-4231-af78-781c74276255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:30:43 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Volume volume-38af3e05-ba59-4a38-ad1e-c9e27cb43da4 (38af3e05-ba59-4a38-ad1e-c9e27cb43da4): created successfully Sep 17 07:30:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec358dea-1bbf-4231-af78-781c74276255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:30:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Flow 'volume_create_manager' (f2b247b2-f243-4b95-b55f-3761b3b270c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:30:44 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-2a43c725-3032-403a-823f-c1d47090d7fd tempest-VolumesTestJSON-1654112816 None] Created volume successfully. Sep 17 07:30:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Acquiring lock "cinder-38af3e05-ba59-4a38-ad1e-c9e27cb43da4-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:30:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Lock "cinder-38af3e05-ba59-4a38-ad1e-c9e27cb43da4-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:30:46 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:30:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Acquiring lock "cinder-quobyte-38af3e05-ba59-4a38-ad1e-c9e27cb43da4" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:30:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Lock "cinder-quobyte-38af3e05-ba59-4a38-ad1e-c9e27cb43da4" acquired by "delete_volume" :: waited 0.018s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:30:46 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deab1af-6519-4250-b495-6c29977ea11a]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:30:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-38af3e05-ba59-4a38-ad1e-c9e27cb43da4 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-38af3e05-ba59-4a38-ad1e-c9e27cb43da4" returned: 0 in 0.805s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-38af3e05-ba59-4a38-ad1e-c9e27cb43da4 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-38af3e05-ba59-4a38-ad1e-c9e27cb43da4" returned: 0 in 0.327s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Lock "cinder-quobyte-38af3e05-ba59-4a38-ad1e-c9e27cb43da4" released by "delete_volume" :: held 1.697s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:30:48 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Created reservations ['f0fd2f64-05a8-45ee-887a-998cc410e6a8', 'bfa0fe30-cf22-45af-a045-b10c999edd5a', '9da69572-59d2-4244-a00b-d3e9d3cc8d2b', '90cfc644-976c-435d-8d86-bff416220510'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:30:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:30:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:30:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:30:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:30:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.157s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:49 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:30:49 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Deleted volume successfully. Sep 17 07:30:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-71d66870-b557-447e-8a8b-f4879926473a tempest-VolumesTestJSON-1654112816 None] Lock "cinder-38af3e05-ba59-4a38-ad1e-c9e27cb43da4-delete_volume" released by "delete_volume" :: held 3.410s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:30:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Acquiring lock "cinder-d4a336a5-7bdf-4ac5-906b-255edb6ac3de-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:30:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Lock "cinder-d4a336a5-7bdf-4ac5-906b-255edb6ac3de-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:30:50 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:30:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Acquiring lock "cinder-quobyte-d4a336a5-7bdf-4ac5-906b-255edb6ac3de" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:30:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Lock "cinder-quobyte-d4a336a5-7bdf-4ac5-906b-255edb6ac3de" acquired by "delete_volume" :: waited 0.024s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:30:50 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b4f311-d069-4101-99cd-a794c31f607b]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:30:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d4a336a5-7bdf-4ac5-906b-255edb6ac3de {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d4a336a5-7bdf-4ac5-906b-255edb6ac3de" returned: 0 in 0.717s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d4a336a5-7bdf-4ac5-906b-255edb6ac3de {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d4a336a5-7bdf-4ac5-906b-255edb6ac3de" returned: 0 in 0.130s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Lock "cinder-quobyte-d4a336a5-7bdf-4ac5-906b-255edb6ac3de" released by "delete_volume" :: held 1.219s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:30:51 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Created reservations ['8e8e6696-8a82-4ce1-a32d-305d23a1e32e', '17fef488-a66a-46a6-834e-108b93310cce', '8e3ec43c-60cb-409a-920f-4e53973fd79e', '2c2c2d6e-ee81-473c-b794-c069a31f796b'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.149s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:30:52 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Deleted volume successfully. Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Acquiring lock "cinder-bc6c9ebc-9060-4bba-be6f-6892bb48ff40-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Lock "cinder-bc6c9ebc-9060-4bba-be6f-6892bb48ff40-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e29dbad5-21fb-4df5-8a4d-1f916edfa245 tempest-VolumesTestJSON-1654112816 None] Lock "cinder-d4a336a5-7bdf-4ac5-906b-255edb6ac3de-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:30:52 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Acquiring lock "cinder-quobyte-bc6c9ebc-9060-4bba-be6f-6892bb48ff40" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Lock "cinder-quobyte-bc6c9ebc-9060-4bba-be6f-6892bb48ff40" acquired by "delete_volume" :: waited 0.039s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a481cc5-18c4-4880-a9f8-b78936f8426c]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:30:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bc6c9ebc-9060-4bba-be6f-6892bb48ff40 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bc6c9ebc-9060-4bba-be6f-6892bb48ff40" returned: 0 in 0.535s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bc6c9ebc-9060-4bba-be6f-6892bb48ff40 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bc6c9ebc-9060-4bba-be6f-6892bb48ff40" returned: 0 in 0.094s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Lock "cinder-quobyte-bc6c9ebc-9060-4bba-be6f-6892bb48ff40" released by "delete_volume" :: held 0.817s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:30:54 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Created reservations ['fc739130-6bd8-4e0d-86ea-c4dd0d8e271d', 'c16480ad-01c8-40d2-b21a-66deb90fcc61', '7b49df9b-9598-43e4-b11d-ac33533d23a3', '1dabbff4-225f-4b8d-aa81-efe1f39bc6a9'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:30:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:30:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:30:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:30:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:30:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:30:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:30:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.118s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:30:54 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:30:54 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Deleted volume successfully. Sep 17 07:30:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ea537704-a6d3-4404-8089-a9c6242de612 tempest-VolumesTestJSON-1654112816 None] Lock "cinder-bc6c9ebc-9060-4bba-be6f-6892bb48ff40-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:31:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-d4246782-5a43-464b-bff9-d108c4e9d6fe tempest-BackendsCapabilitiesAdminTestsJSON-495084959 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83207) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 17 07:31:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-574f4c64-18f0-4fab-b2ee-abd831e0b8e4 tempest-BackendsCapabilitiesAdminTestsJSON-495084959 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154739379883, 'free_capacity_gb': 924.9154739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83207) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 17 07:31:04 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:DELETE=2,cinder:SELECT=13,cinder:UPDATE=24,cinder:INSERT=5 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:31:04 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=31,cinder:UPDATE=41,cinder:INSERT=11,cinder:DELETE=5 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:31:12 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-ea9feae9-9fa5-4317-83a0-2ca0693f3efb tempest-GroupSnapshotsV319Test-696773341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:31:12 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ea9feae9-9fa5-4317-83a0-2ca0693f3efb tempest-GroupSnapshotsV319Test-696773341 None] Group tempest-GroupSnapshotsV319Test-Group-559852965: creating Sep 17 07:31:12 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ea9feae9-9fa5-4317-83a0-2ca0693f3efb tempest-GroupSnapshotsV319Test-696773341 None] Group tempest-GroupSnapshotsV319Test-Group-559852965: created successfully Sep 17 07:31:12 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ea9feae9-9fa5-4317-83a0-2ca0693f3efb tempest-GroupSnapshotsV319Test-696773341 None] Create group completed successfully. Sep 17 07:31:16 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Flow 'volume_create_manager' (38d978b2-da3f-4c85-97b1-b6a8e09e659c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17da9e6b-2e86-481d-a441-4aad0e9a6991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17da9e6b-2e86-481d-a441-4aad0e9a6991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1479018580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a1fcd5d2-0bed-4ac4-8f0e-96f2eac0e589,host='devstack@QuobyteHD#QuobyteHD',id=a987bee5-3e34-4867-93fb-e4ad0a9a228a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='836374c9990c4634bc0bf3764858a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:31:16Z,use_quota=True,user_id='d2934889e7d54ccea6b8bbaf8857adf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccc0d609-d9e6-4212-b508-71f37265cf14),volume_type_id=ccc0d609-d9e6-4212-b508-71f37265cf14)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293a0cde-71ca-4a09-901e-458d2ed5e86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293a0cde-71ca-4a09-901e-458d2ed5e86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8baa1c-568a-4ff1-b17a-76ac9aabba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8baa1c-568a-4ff1-b17a-76ac9aabba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a987bee5-3e34-4867-93fb-e4ad0a9a228a', 'volume_name': 'volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aaa3d0c-cdc2-4614-befe-9aa1440be2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aaa3d0c-cdc2-4614-befe-9aa1440be2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63362672-641b-4e83-9fb4-224ac0590ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:31:16 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Volume a987bee5-3e34-4867-93fb-e4ad0a9a228a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a', 'volume_size': 1} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a1fcd5d2-0bed-4ac4-8f0e-96f2eac0e589,created_at=2025-09-17T05:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1479018580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a1fcd5d2-0bed-4ac4-8f0e-96f2eac0e589,host='devstack@QuobyteHD#QuobyteHD',id=a987bee5-3e34-4867-93fb-e4ad0a9a228a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='836374c9990c4634bc0bf3764858a471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:31:16Z,use_quota=True,user_id='d2934889e7d54ccea6b8bbaf8857adf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ccc0d609-d9e6-4212-b508-71f37265cf14),volume_type_id=ccc0d609-d9e6-4212-b508-71f37265cf14)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Creating volume a987bee5-3e34-4867-93fb-e4ad0a9a228a {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:31:16 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:31:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:17 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=17, name=volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:31:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a 1073741824" returned: 0 in 0.822s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a" returned: 0 in 0.617s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] <== create_volume: return (1729ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:31:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:31:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63362672-641b-4e83-9fb4-224ac0590ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:31:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196270a6-b3d8-4d73-864b-b6ade37439f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:31:19 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Volume volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a (a987bee5-3e34-4867-93fb-e4ad0a9a228a): created successfully Sep 17 07:31:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196270a6-b3d8-4d73-864b-b6ade37439f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:31:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Flow 'volume_create_manager' (38d978b2-da3f-4c85-97b1-b6a8e09e659c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:31:19 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-1153919a-5554-453a-ac66-a96f1c59b3ce tempest-GroupSnapshotsV319Test-696773341 None] Created volume successfully. Sep 17 07:31:20 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] GroupSnapshot b41125bc-ae2a-4c40-95e4-d33f1a3434ce: creating. Sep 17 07:31:20 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:31:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] Group snapshot b41125bc-ae2a-4c40-95e4-d33f1a3434ce: creating. {{(pid=83207) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 17 07:31:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:31:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:31:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] Creating offline snapshot 940af32a-c9e3-42e3-b397-3291d5788b21 of volume a987bee5-3e34-4867-93fb-e4ad0a9a228a {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:31:20 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9826b4-e48d-4f6c-a24f-0c8ccab5ce34]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:31:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a" returned: 0 in 0.722s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:21 devstack quobyte-client[83219]: System call of process 88223 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:31:21 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=18, name=volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:31:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21 1G" returned: 0 in 0.465s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:22 devstack quobyte-client[83219]: System call of process 88226 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:31:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] CMD "qemu-img rebase -u -b volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21" returned: 0 in 0.253s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:31:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21" returned: 0 in 0.105s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:31:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21" returned: 0 in 0.125s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.info" returned: 0 in 0.209s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:31:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.info" returned: 0 in 0.230s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.703s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:31:24 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-26d63e64-ad77-4cb4-b657-c09542d94310 tempest-GroupSnapshotsV319Test-696773341 None] group_snapshot b41125bc-ae2a-4c40-95e4-d33f1a3434ce: created successfully Sep 17 07:31:25 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] group_snapshot b41125bc-ae2a-4c40-95e4-d33f1a3434ce: deleting Sep 17 07:31:25 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:31:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] group_snapshot b41125bc-ae2a-4c40-95e4-d33f1a3434ce: deleting {{(pid=83207) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 17 07:31:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Acquiring lock "cinder-quobyte-a987bee5-3e34-4867-93fb-e4ad0a9a228a" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:31:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Lock "cinder-quobyte-a987bee5-3e34-4867-93fb-e4ad0a9a228a" acquired by "delete_snapshot" :: waited 0.072s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:31:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Acquiring lock "cinder-quobyte-940af32a-c9e3-42e3-b397-3291d5788b21" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:31:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Lock "cinder-quobyte-940af32a-c9e3-42e3-b397-3291d5788b21" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:31:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Deleting offline snapshot 940af32a-c9e3-42e3-b397-3291d5788b21 of volume a987bee5-3e34-4867-93fb-e4ad0a9a228a {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:31:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] snapshot_file for this snap is: volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:31:26 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98056b2-d15e-4e97-9b6d-af96bb0cee5e]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:31:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:27 devstack quobyte-client[83219]: System call of process 88235 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:31:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:31:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:31:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:31:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:31:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:31:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:31:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21" returned: 0 in 0.986s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:31:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.292s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:31:27 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c29a99-ec25-4055-ae38-c5ecfb7cf1cb]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:31:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a" returned: 0 in 0.767s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21" returned: 0 in 0.399s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a.940af32a-c9e3-42e3-b397-3291d5788b21" returned: 0 in 0.143s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Lock "cinder-quobyte-940af32a-c9e3-42e3-b397-3291d5788b21" released by "_delete_snapshot" :: held 2.962s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:31:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Lock "cinder-quobyte-a987bee5-3e34-4867-93fb-e4ad0a9a228a" released by "delete_snapshot" :: held 3.011s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:31:29 devstack cinder-volume[83207]: WARNING cinder.quota [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1086947219 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1086947219, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:31:29 devstack cinder-volume[83207]: WARNING cinder.quota [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1086947219 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1086947219, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:31:29 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] Created reservations ['e350c117-8e07-4fd4-899f-22445a475849', 'f47bbbd6-5bd1-4dc5-b55b-0cb3f79c4add', '914a018e-7366-4347-b96f-87c4738e9e88', 'fb6f529d-95c4-4f15-9fd7-d071d139766d'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:31:30 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4c190616-8d52-4a19-817f-879122a96ca5 tempest-GroupSnapshotsV319Test-696773341 None] group_snapshot b41125bc-ae2a-4c40-95e4-d33f1a3434ce: deleted successfully Sep 17 07:31:31 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:31:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Acquiring lock "cinder-quobyte-a987bee5-3e34-4867-93fb-e4ad0a9a228a" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:31:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Lock "cinder-quobyte-a987bee5-3e34-4867-93fb-e4ad0a9a228a" acquired by "delete_volume" :: waited 0.059s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:31:31 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[956d7e69-a0c3-4516-9f06-9c98860c2aa4]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:31:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a" returned: 0 in 0.718s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a987bee5-3e34-4867-93fb-e4ad0a9a228a" returned: 0 in 0.199s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Lock "cinder-quobyte-a987bee5-3e34-4867-93fb-e4ad0a9a228a" released by "delete_volume" :: held 1.324s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:31:34 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Created reservations ['399a536d-fafa-400a-b471-1393306ac22c'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:31:35 devstack cinder-volume[83207]: WARNING cinder.quota [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1086947219 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1086947219, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:31:35 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Created reservations ['e0bf687e-bca2-45a4-b2a8-1074bf27baf8', '94926ec1-d6cd-4925-8b73-6266fc6c5761', '2065c181-e70c-4fcc-aef1-4d4800418657', '0451ed81-78f5-41fd-9bbc-670eaeddffd1'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:31:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:31:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:31:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:31:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:31:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:31:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:31:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.628s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:31:36 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:31:36 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-0e8786d8-2454-4f0e-89aa-cd9ef13d2473 tempest-GroupSnapshotsV319Test-696773341 None] Delete group completed successfully. Sep 17 07:31:45 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=21,cinder:UPDATE=33,cinder:DELETE=1,cinder:INSERT=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:31:45 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=10,cinder:SELECT=26,cinder:INSERT=7 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:32:06 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:32:06 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:32:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:32:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:32:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:32:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:32:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:32:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:32:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.161s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:32:32 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:32 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:32:32 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Flow 'volume_create_manager' (c728f8c3-53ad-402f-b0fb-ebed1d687c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:32:32 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fe4f60-371b-4599-b077-b971dba2e158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:32 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fe4f60-371b-4599-b077-b971dba2e158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1789881567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5dfc7e-152c-471e-b2dc-75303a97ce07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8b6c19be1347a49b1c30388ca9a0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:32:32Z,use_quota=True,user_id='6a209dea28f04fe2a113a3bfb364133d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:32 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea2e5d9-680c-4c2d-9f2f-7bcf650876f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:32 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea2e5d9-680c-4c2d-9f2f-7bcf650876f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:32 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2faa4b-c3d4-4f22-bfc4-4ca4f8edfe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:32 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2faa4b-c3d4-4f22-bfc4-4ca4f8edfe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce5dfc7e-152c-471e-b2dc-75303a97ce07', 'volume_name': 'volume-ce5dfc7e-152c-471e-b2dc-75303a97ce07', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:32 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16422cb2-3d60-4b19-ad4e-e1e6af63c27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16422cb2-3d60-4b19-ad4e-e1e6af63c27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0e348f-2f1a-44be-b669-de8c31a52f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:33 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Volume ce5dfc7e-152c-471e-b2dc-75303a97ce07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce5dfc7e-152c-471e-b2dc-75303a97ce07', 'volume_size': 1} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1789881567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5dfc7e-152c-471e-b2dc-75303a97ce07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8b6c19be1347a49b1c30388ca9a0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:32:32Z,use_quota=True,user_id='6a209dea28f04fe2a113a3bfb364133d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Creating volume ce5dfc7e-152c-471e-b2dc-75303a97ce07 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:32:33 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ce5dfc7e-152c-471e-b2dc-75303a97ce07 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:33 devstack quobyte-client[83219]: System call of process 88926 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:32:33 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=20, name=volume-ce5dfc7e-152c-471e-b2dc-75303a97ce07, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ce5dfc7e-152c-471e-b2dc-75303a97ce07 1073741824" returned: 0 in 0.595s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ce5dfc7e-152c-471e-b2dc-75303a97ce07 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ce5dfc7e-152c-471e-b2dc-75303a97ce07" returned: 0 in 0.155s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] <== create_volume: return (891ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:32:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:32:34 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0e348f-2f1a-44be-b669-de8c31a52f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce5dfc7e-152c-471e-b2dc-75303a97ce07', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:34 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57bd013-3606-4e58-a323-41eef47b935c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:34 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Volume volume-ce5dfc7e-152c-471e-b2dc-75303a97ce07 (ce5dfc7e-152c-471e-b2dc-75303a97ce07): created successfully Sep 17 07:32:34 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57bd013-3606-4e58-a323-41eef47b935c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:34 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Flow 'volume_create_manager' (c728f8c3-53ad-402f-b0fb-ebed1d687c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:32:34 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-16c59a1e-22f1-4811-a78e-ceab5741280c tempest-ServersNegativeTestJSON-52291229 None] Created volume successfully. Sep 17 07:32:37 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-3fc27c0f-eaf6-4e53-94af-3e9829334bc7 req-840b5571-0387-4a76-9de6-1d13b5f1f035 tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:37 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-3fc27c0f-eaf6-4e53-94af-3e9829334bc7 req-840b5571-0387-4a76-9de6-1d13b5f1f035 tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:37 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-3fc27c0f-eaf6-4e53-94af-3e9829334bc7 req-840b5571-0387-4a76-9de6-1d13b5f1f035 tempest-TaggedBootDevicesTest-1684484443 None] Terminate volume connection completed successfully. Sep 17 07:32:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-3fc27c0f-eaf6-4e53-94af-3e9829334bc7 req-840b5571-0387-4a76-9de6-1d13b5f1f035 tempest-TaggedBootDevicesTest-1684484443 None] Deleting attachment 24378a63-5eb9-4cf5-bf64-c6e5f6d6c3b3. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:32:37 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:37 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Flow 'volume_create_manager' (86fb202d-5744-40cd-b2ca-90eb5ec4588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bc2eb3-77e5-4ff1-9baa-fb7cccb00f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33bc2eb3-77e5-4ff1-9baa-fb7cccb00f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1101356350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43ee779-387f-4456-bdda-5cb4c4d79a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8b6c19be1347a49b1c30388ca9a0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:32:38Z,use_quota=True,user_id='6a209dea28f04fe2a113a3bfb364133d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20517215-aca4-49a8-8bf3-c61be3f286e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20517215-aca4-49a8-8bf3-c61be3f286e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb84edf4-d006-4bdd-9168-2c3f6b7fd4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb84edf4-d006-4bdd-9168-2c3f6b7fd4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b43ee779-387f-4456-bdda-5cb4c4d79a24', 'volume_name': 'volume-b43ee779-387f-4456-bdda-5cb4c4d79a24', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a18ec70-ec94-404e-b1d7-04c04c7432eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a18ec70-ec94-404e-b1d7-04c04c7432eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb71041-637a-4850-8bf6-3a9436b09a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:38 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Volume b43ee779-387f-4456-bdda-5cb4c4d79a24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b43ee779-387f-4456-bdda-5cb4c4d79a24', 'volume_size': 1} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1101356350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43ee779-387f-4456-bdda-5cb4c4d79a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c8b6c19be1347a49b1c30388ca9a0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:32:38Z,use_quota=True,user_id='6a209dea28f04fe2a113a3bfb364133d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Creating volume b43ee779-387f-4456-bdda-5cb4c4d79a24 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:32:38 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b43ee779-387f-4456-bdda-5cb4c4d79a24 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:38 devstack quobyte-client[83219]: System call of process 88938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:32:38 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=21, name=volume-b43ee779-387f-4456-bdda-5cb4c4d79a24, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:32:38 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-3fc27c0f-eaf6-4e53-94af-3e9829334bc7 req-9af9cfe0-5fe0-4d61-8171-f62ba21bd34b tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:38 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-3fc27c0f-eaf6-4e53-94af-3e9829334bc7 req-9af9cfe0-5fe0-4d61-8171-f62ba21bd34b tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:38 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-3fc27c0f-eaf6-4e53-94af-3e9829334bc7 req-9af9cfe0-5fe0-4d61-8171-f62ba21bd34b tempest-TaggedBootDevicesTest-1684484443 None] Terminate volume connection completed successfully. Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-3fc27c0f-eaf6-4e53-94af-3e9829334bc7 req-9af9cfe0-5fe0-4d61-8171-f62ba21bd34b tempest-TaggedBootDevicesTest-1684484443 None] Deleting attachment 3135b8c8-ff8c-4374-9d25-926c279e9ed8. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b43ee779-387f-4456-bdda-5cb4c4d79a24 1073741824" returned: 0 in 0.639s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b43ee779-387f-4456-bdda-5cb4c4d79a24 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b43ee779-387f-4456-bdda-5cb4c4d79a24" returned: 0 in 0.163s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] <== create_volume: return (887ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:32:39 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-3fc27c0f-eaf6-4e53-94af-3e9829334bc7 req-078732a2-76e2-4882-b131-37b9998548d7 tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb71041-637a-4850-8bf6-3a9436b09a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43ee779-387f-4456-bdda-5cb4c4d79a24', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61525cb6-79b3-47d1-aba3-301ec95ece01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:39 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Flow 'volume_create_manager' (655b4d03-d7d8-4dbd-8642-be9d67e6da36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9531a42-cc71-451c-ba5b-83a42e8cc702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9531a42-cc71-451c-ba5b-83a42e8cc702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-788123253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b788453-14c5-46e0-986a-21391f20d2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b533ea4f44134e2aa6e8e5b7b0217f0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:32:39Z,use_quota=True,user_id='a9babfd51ab94d5380033fff6839631f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277c975a-e81a-4f0b-9d2a-e6fd52c85618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (277c975a-e81a-4f0b-9d2a-e6fd52c85618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daba2786-1768-420f-836a-25717fb0a5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daba2786-1768-420f-836a-25717fb0a5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b788453-14c5-46e0-986a-21391f20d2ab', 'volume_name': 'volume-4b788453-14c5-46e0-986a-21391f20d2ab', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e40432-46ed-4187-8181-ad714670d5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e40432-46ed-4187-8181-ad714670d5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3600e06c-fa96-4389-a63a-62684f44d053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:39 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Volume 4b788453-14c5-46e0-986a-21391f20d2ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b788453-14c5-46e0-986a-21391f20d2ab', 'volume_size': 1} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-788123253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b788453-14c5-46e0-986a-21391f20d2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b533ea4f44134e2aa6e8e5b7b0217f0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:32:39Z,use_quota=True,user_id='a9babfd51ab94d5380033fff6839631f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Creating volume 4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:32:39 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:32:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:40 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Volume volume-b43ee779-387f-4456-bdda-5cb4c4d79a24 (b43ee779-387f-4456-bdda-5cb4c4d79a24): created successfully Sep 17 07:32:40 devstack quobyte-client[83219]: System call of process 88942 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:32:40 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=22, name=volume-4b788453-14c5-46e0-986a-21391f20d2ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:32:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61525cb6-79b3-47d1-aba3-301ec95ece01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Flow 'volume_create_manager' (86fb202d-5744-40cd-b2ca-90eb5ec4588c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:32:40 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-3fc27c0f-eaf6-4e53-94af-3e9829334bc7 req-078732a2-76e2-4882-b131-37b9998548d7 tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:40 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-3fc27c0f-eaf6-4e53-94af-3e9829334bc7 req-078732a2-76e2-4882-b131-37b9998548d7 tempest-TaggedBootDevicesTest-1684484443 None] Terminate volume connection completed successfully. Sep 17 07:32:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-3fc27c0f-eaf6-4e53-94af-3e9829334bc7 req-078732a2-76e2-4882-b131-37b9998548d7 tempest-TaggedBootDevicesTest-1684484443 None] Deleting attachment 631cd67a-c588-4bfe-8397-d67083bdab98. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:32:40 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-241cd24b-81c2-4e4d-b0ce-4fb788a95cf8 tempest-ServersNegativeTestJSON-52291229 None] Created volume successfully. Sep 17 07:32:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab 1073741824" returned: 0 in 0.553s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab" returned: 0 in 0.454s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] <== create_volume: return (1040ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:32:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:32:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3600e06c-fa96-4389-a63a-62684f44d053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b788453-14c5-46e0-986a-21391f20d2ab', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acec8a67-ef8d-4d1d-b466-9e7886174867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:32:41 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Volume volume-4b788453-14c5-46e0-986a-21391f20d2ab (4b788453-14c5-46e0-986a-21391f20d2ab): created successfully Sep 17 07:32:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acec8a67-ef8d-4d1d-b466-9e7886174867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:32:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Flow 'volume_create_manager' (655b4d03-d7d8-4dbd-8642-be9d67e6da36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:32:41 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-6a7d608c-cbe1-4aac-8010-383cefbd8e9d tempest-SnapshotsActionsTest-476714385 None] Created volume successfully. Sep 17 07:32:41 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Acquiring lock "cinder-b43ee779-387f-4456-bdda-5cb4c4d79a24-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:32:41 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Lock "cinder-b43ee779-387f-4456-bdda-5cb4c4d79a24-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:32:41 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:41 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Acquiring lock "cinder-quobyte-b43ee779-387f-4456-bdda-5cb4c4d79a24" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:32:41 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Lock "cinder-quobyte-b43ee779-387f-4456-bdda-5cb4c4d79a24" acquired by "delete_volume" :: waited 0.022s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:32:41 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d764200-c1ff-4d15-bf5a-5f9a643810a1]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:32:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b43ee779-387f-4456-bdda-5cb4c4d79a24 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b43ee779-387f-4456-bdda-5cb4c4d79a24" returned: 0 in 0.877s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b43ee779-387f-4456-bdda-5cb4c4d79a24 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:42 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:32:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:32:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] Creating offline snapshot 280d7d74-c3a0-4080-bc94-9e9f86b1e64e of volume 4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:32:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b43ee779-387f-4456-bdda-5cb4c4d79a24" returned: 0 in 0.384s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:43 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e441c2b0-5ddf-497e-af2c-bfe806ca0630]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:32:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:43 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Lock "cinder-quobyte-b43ee779-387f-4456-bdda-5cb4c4d79a24" released by "delete_volume" :: held 1.490s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:32:44 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Created reservations ['39db2893-8f77-45f0-b99f-e64c073aaf70', '9e52b0a4-828f-4fcf-8d35-17aa76fa75ef', 'cd7404a8-e892-4fba-a990-48967fec5c6d', '4a584b90-ad65-4315-b9c8-9235c5d022a1'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:32:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab" returned: 0 in 1.085s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:44 devstack quobyte-client[83219]: System call of process 88964 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:32:44 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=23, name=volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:32:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:32:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.087s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:32:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:32:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:32:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.085s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:32:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:45 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Acquiring lock "cinder-ce5dfc7e-152c-471e-b2dc-75303a97ce07-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:32:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e 1G" returned: 0 in 1.739s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4b788453-14c5-46e0-986a-21391f20d2ab -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 1.112s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:46 devstack quobyte-client[83219]: System call of process 88998 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:32:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Lock "cinder-ce5dfc7e-152c-471e-b2dc-75303a97ce07-delete_volume" acquired by "delete_volume" :: waited 0.853s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:32:46 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:32:46 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Deleted volume successfully. Sep 17 07:32:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] CMD "qemu-img rebase -u -b volume-4b788453-14c5-46e0-986a-21391f20d2ab -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e" returned: 0 in 0.940s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:32:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e" returned: 0 in 0.294s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:32:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-19392125-e367-4537-8d98-a21bd7298774 tempest-ServersNegativeTestJSON-52291229 None] Lock "cinder-b43ee779-387f-4456-bdda-5cb4c4d79a24-delete_volume" released by "delete_volume" :: held 5.731s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:32:47 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Acquiring lock "cinder-quobyte-ce5dfc7e-152c-471e-b2dc-75303a97ce07" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:32:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e" returned: 0 in 0.276s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.info" returned: 0 in 0.126s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:32:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Lock "cinder-quobyte-ce5dfc7e-152c-471e-b2dc-75303a97ce07" acquired by "delete_volume" :: waited 0.330s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:32:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.info" returned: 0 in 0.242s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.049s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:32:48 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1a0c2e-0fe9-4383-bdae-03f9a43dc3d8]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:32:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ce5dfc7e-152c-471e-b2dc-75303a97ce07 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:48 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-1cccd331-879b-4aa0-b5cb-49dbc3e2d3c7 tempest-SnapshotsActionsTest-476714385 None] Create snapshot completed successfully Sep 17 07:32:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ce5dfc7e-152c-471e-b2dc-75303a97ce07" returned: 0 in 0.704s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ce5dfc7e-152c-471e-b2dc-75303a97ce07 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ce5dfc7e-152c-471e-b2dc-75303a97ce07" returned: 0 in 0.174s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Lock "cinder-quobyte-ce5dfc7e-152c-471e-b2dc-75303a97ce07" released by "delete_volume" :: held 1.347s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:32:49 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Created reservations ['5c53f335-8baf-4163-b179-c62c22ddaf71', '2a0e8084-495f-4a5b-8b1d-5815c59caaa7', '9e11ec79-c0c6-431d-893d-c28b19987bfb', '1374d52d-6bff-4c25-8747-571e51aa36c8'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:32:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:32:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:32:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:32:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:32:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:32:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.239s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:50 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:32:50 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Deleted volume successfully. Sep 17 07:32:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e4a708d3-708f-4d08-8005-5dd86aaa1c1f tempest-ServersNegativeTestJSON-52291229 None] Lock "cinder-ce5dfc7e-152c-471e-b2dc-75303a97ce07-delete_volume" released by "delete_volume" :: held 4.877s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:32:51 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:32:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:32:51 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] Creating offline snapshot b6743749-76d2-4616-b61a-3052fe4dade8 of volume 4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:32:51 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9092754-c39d-4595-b70d-740c701d32af]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:32:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e" returned: 0 in 0.889s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b788453-14c5-46e0-986a-21391f20d2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:32:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:53 devstack quobyte-client[83219]: System call of process 89026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:32:53 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=25, name=volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:32:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8 1G" returned: 0 in 0.974s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] CMD "qemu-img rebase -u -b volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8" returned: 0 in 0.582s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:32:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8" returned: 0 in 0.269s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:55 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:32:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8" returned: 0 in 0.169s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.531s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:32:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "cinder-b86348a0-069b-476a-9a05-848ba728ec40-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:32:55 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ac57acf9-98cd-445d-a4a3-ad163e469236 tempest-SnapshotsActionsTest-476714385 None] Create snapshot completed successfully Sep 17 07:32:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Lock "cinder-b86348a0-069b-476a-9a05-848ba728ec40-delete_volume" acquired by "delete_volume" :: waited 0.206s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:32:55 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "cinder-quobyte-b86348a0-069b-476a-9a05-848ba728ec40" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:32:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Lock "cinder-quobyte-b86348a0-069b-476a-9a05-848ba728ec40" acquired by "delete_volume" :: waited 0.022s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:32:55 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d67ebf8-cc53-4067-aa88-7192e189e85f]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:32:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b86348a0-069b-476a-9a05-848ba728ec40 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Acquiring lock "cinder-b6743749-76d2-4616-b61a-3052fe4dade8-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:32:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-b6743749-76d2-4616-b61a-3052fe4dade8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.095s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:32:56 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Acquiring lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:32:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b86348a0-069b-476a-9a05-848ba728ec40" returned: 0 in 0.688s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b86348a0-069b-476a-9a05-848ba728ec40 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" acquired by "delete_snapshot" :: waited 0.207s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:32:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Acquiring lock "cinder-quobyte-b6743749-76d2-4616-b61a-3052fe4dade8" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:32:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b86348a0-069b-476a-9a05-848ba728ec40" returned: 0 in 0.235s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-b6743749-76d2-4616-b61a-3052fe4dade8" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:32:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Deleting offline snapshot b6743749-76d2-4616-b61a-3052fe4dade8 of volume 4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:32:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] snapshot_file for this snap is: volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:32:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Lock "cinder-quobyte-b86348a0-069b-476a-9a05-848ba728ec40" released by "delete_volume" :: held 1.043s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:32:56 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1482830a-acd1-4a85-ad26-220b49aee85a]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:32:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:57 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Created reservations ['bfd08be1-d8c0-4925-9bb9-d278b7646f03', '9783b4e3-a24e-4a78-954a-2b385caa4861', '512e5069-c605-472d-86cc-b09e1dcf0233', 'b17a5d0f-7154-4f3d-a8af-a070dc358f36'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:32:57 devstack quobyte-client[83219]: System call of process 89078 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:32:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8" returned: 0 in 0.614s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:57 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b788453-14c5-46e0-986a-21391f20d2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:32:57 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fc94bf-4c63-49f7-9f14-db60d3aab258]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:32:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:32:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:32:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:32:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:32:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:32:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e" returned: 0 in 0.594s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b788453-14c5-46e0-986a-21391f20d2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:32:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.249s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:58 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:32:58 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Deleted volume successfully. Sep 17 07:32:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5bae0338-7da9-4f00-81f5-57b521652323 tempest-TaggedBootDevicesTest-1684484443 None] Lock "cinder-b86348a0-069b-476a-9a05-848ba728ec40-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:32:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8" returned: 0 in 0.453s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "cinder-7c9385fc-f35d-479d-bcb3-589cb14bc44f-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:32:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.b6743749-76d2-4616-b61a-3052fe4dade8" returned: 0 in 0.335s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:32:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-b6743749-76d2-4616-b61a-3052fe4dade8" released by "_delete_snapshot" :: held 2.349s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:32:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Lock "cinder-7c9385fc-f35d-479d-bcb3-589cb14bc44f-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:32:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" released by "delete_snapshot" :: held 2.549s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:32:59 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:32:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "cinder-quobyte-7c9385fc-f35d-479d-bcb3-589cb14bc44f" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:32:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Lock "cinder-quobyte-7c9385fc-f35d-479d-bcb3-589cb14bc44f" acquired by "delete_volume" :: waited 0.076s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:32:59 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Created reservations ['93499367-5465-46c6-a195-ef8f2aeefd05', '337659e5-2076-473e-b908-ea8f64426e10', 'fcaad554-b580-4469-8343-17fa22a75947', 'cf2e6221-0d32-428a-8182-5cd3cfaf3953'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:32:59 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[731dd8d1-66eb-49f6-8f5d-f92bdb023df6]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:32:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:32:59 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Delete snapshot completed successfully. Sep 17 07:32:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0e2b1396-63e2-4869-bccc-bddbb964cc7d tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-b6743749-76d2-4616-b61a-3052fe4dade8-delete_snapshot" released by "delete_snapshot" :: held 3.388s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f" returned: 0 in 0.548s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7c9385fc-f35d-479d-bcb3-589cb14bc44f" returned: 0 in 0.121s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Lock "cinder-quobyte-7c9385fc-f35d-479d-bcb3-589cb14bc44f" released by "delete_volume" :: held 0.820s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:00 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Created reservations ['aa6b69f0-35bb-4300-8073-0dc4dce27ca0', 'ebbd9ef5-c6f5-41eb-b59c-6ff367b14372', '99d1eea0-fd19-4889-a2c8-b961d3b84e4b', 'e0a4b02d-3f3f-4604-91fe-f26e0e316136'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:33:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:33:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:33:00 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:33:00 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:33:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:33:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.095s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:00 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:33:01 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Deleted volume successfully. Sep 17 07:33:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5b08500d-d9d5-4acf-ab66-0f95065191ea tempest-TaggedBootDevicesTest-1684484443 None] Lock "cinder-7c9385fc-f35d-479d-bcb3-589cb14bc44f-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:01 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:33:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:33:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:33:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] Creating offline snapshot 3a9c19e7-93e6-43f4-892f-b33d08bc8fcf of volume 4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:33:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "cinder-9c8b6a01-fb40-4661-bf75-be0e85949021-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:01 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3976a873-d92d-49fe-bfd0-03da19feffa0]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:33:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Lock "cinder-9c8b6a01-fb40-4661-bf75-be0e85949021-delete_volume" acquired by "delete_volume" :: waited 0.214s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:01 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:33:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "cinder-quobyte-9c8b6a01-fb40-4661-bf75-be0e85949021" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Lock "cinder-quobyte-9c8b6a01-fb40-4661-bf75-be0e85949021" acquired by "delete_volume" :: waited 0.016s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:02 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[24282188-4638-4bbe-a316-59e8f57cde75]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:33:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e" returned: 0 in 0.722s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b788453-14c5-46e0-986a-21391f20d2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:33:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:02 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=26, name=volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:33:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf 1G" returned: 0 in 0.330s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:02 devstack quobyte-client[83219]: System call of process 89099 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:33:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021" returned: 0 in 0.656s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] CMD "qemu-img rebase -u -b volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf" returned: 0 in 0.211s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:33:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf" returned: 0 in 0.170s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:33:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf" returned: 0 in 0.157s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:33:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021" returned: 1 in 0.749s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:33:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:03 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-2abcfbef-5da9-4971-a185-6b03e249587e tempest-SnapshotsActionsTest-476714385 None] Create snapshot completed successfully Sep 17 07:33:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9c8b6a01-fb40-4661-bf75-be0e85949021" returned: 0 in 0.230s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:03 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Lock "cinder-quobyte-9c8b6a01-fb40-4661-bf75-be0e85949021" released by "delete_volume" :: held 1.921s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:04 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Created reservations ['d11a5dbe-c6b1-4a23-a55f-8cdf7d769899', '8c5d7ac6-e956-4861-9709-3c108acbd902', 'c7b76605-6220-49f8-974d-bf7dde18d086', 'a726a3d6-e03e-4a0a-9f56-a4d01edb2745'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:33:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:33:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:33:04 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:33:04 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:33:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:33:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.181s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:04 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:33:04 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Deleted volume successfully. Sep 17 07:33:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Acquiring lock "cinder-3a9c19e7-93e6-43f4-892f-b33d08bc8fcf-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-3a9c19e7-93e6-43f4-892f-b33d08bc8fcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.093s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:05 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:33:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Acquiring lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2801baa0-5f4f-49ba-8142-ce24f92212ab tempest-TaggedBootDevicesTest-1684484443 None] Lock "cinder-9c8b6a01-fb40-4661-bf75-be0e85949021-delete_volume" released by "delete_volume" :: held 3.433s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Acquiring lock "cinder-quobyte-3a9c19e7-93e6-43f4-892f-b33d08bc8fcf" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-3a9c19e7-93e6-43f4-892f-b33d08bc8fcf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Deleting offline snapshot 3a9c19e7-93e6-43f4-892f-b33d08bc8fcf of volume 4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:33:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] snapshot_file for this snap is: volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:33:05 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[de659dd8-6e89-4aa6-a157-5167baa47b82]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:33:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:05 devstack quobyte-client[83219]: System call of process 89117 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:33:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf" returned: 0 in 0.686s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b788453-14c5-46e0-986a-21391f20d2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:33:05 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4342a4-6714-428d-a9b3-a3e11ed01df2]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:33:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:06 devstack quobyte-client[83219]: System call of process 89120 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:33:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e" returned: 0 in 0.554s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b788453-14c5-46e0-986a-21391f20d2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:33:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf" returned: 0 in 0.318s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.3a9c19e7-93e6-43f4-892f-b33d08bc8fcf" returned: 0 in 0.130s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:07 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-3a9c19e7-93e6-43f4-892f-b33d08bc8fcf" released by "_delete_snapshot" :: held 2.210s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:07 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" released by "delete_snapshot" :: held 2.234s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:07 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Created reservations ['3f8025e1-7445-406f-aad6-34b084b104e7', '8a56bc7b-5f2d-4f29-83c1-2d5d457b1048', '41db101e-c50d-4ecd-a063-3b145f1ba3c5', 'a9b51b7f-0b12-4134-abaa-b1acecfe0a54'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:33:08 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Delete snapshot completed successfully. Sep 17 07:33:08 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-de02b03e-b3c3-43af-b1bb-2ebbd627d724 tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-3a9c19e7-93e6-43f4-892f-b33d08bc8fcf-delete_snapshot" released by "delete_snapshot" :: held 3.203s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:09 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:33:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:33:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:33:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] Creating offline snapshot 508a214c-9fa4-4697-ae8a-66d3b40f503b of volume 4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:33:09 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2379cbaa-bad2-4608-aff2-6b4cd1c58dd7]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:33:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e" returned: 0 in 0.668s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b788453-14c5-46e0-986a-21391f20d2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:33:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:10 devstack quobyte-client[83219]: System call of process 89132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:33:10 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=27, name=volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:33:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b 1G" returned: 0 in 0.540s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:11 devstack quobyte-client[83219]: System call of process 89136 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:33:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] CMD "qemu-img rebase -u -b volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b" returned: 0 in 0.258s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:11 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:33:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b" returned: 0 in 0.145s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:11 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:33:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b" returned: 0 in 0.143s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.126s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:33:12 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-04dae0e0-118d-42a4-b159-fd84ba1d9953 tempest-SnapshotsActionsTest-476714385 None] Create snapshot completed successfully Sep 17 07:33:13 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Acquiring lock "cinder-508a214c-9fa4-4697-ae8a-66d3b40f503b-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:13 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-508a214c-9fa4-4697-ae8a-66d3b40f503b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:13 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:33:13 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Acquiring lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:13 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:13 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Acquiring lock "cinder-quobyte-508a214c-9fa4-4697-ae8a-66d3b40f503b" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:13 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-508a214c-9fa4-4697-ae8a-66d3b40f503b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Deleting offline snapshot 508a214c-9fa4-4697-ae8a-66d3b40f503b of volume 4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:33:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] snapshot_file for this snap is: volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:33:13 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb541de6-3441-40d8-bebf-dac27d0690e2]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:33:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b" returned: 0 in 0.507s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b788453-14c5-46e0-986a-21391f20d2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:33:13 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc34e15-2fa1-4f23-92e1-f24266c30a1d]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:33:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:14 devstack quobyte-client[83219]: System call of process 89144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:33:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e" returned: 0 in 0.489s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b788453-14c5-46e0-986a-21391f20d2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:33:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:14 devstack quobyte-client[83219]: System call of process 89148 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:33:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b" returned: 0 in 0.271s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.508a214c-9fa4-4697-ae8a-66d3b40f503b" returned: 0 in 0.125s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-508a214c-9fa4-4697-ae8a-66d3b40f503b" released by "_delete_snapshot" :: held 1.754s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" released by "delete_snapshot" :: held 1.778s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:15 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Created reservations ['44ffceb3-5125-4eb3-a0d9-8caa449a912a', '29ab238b-c09c-4209-ac52-3d174b3cddfc', '151c66e8-658b-4a26-a400-71e252358a00', 'af1fcfe2-efff-4652-8900-17d30d12052e'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:33:15 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Delete snapshot completed successfully. Sep 17 07:33:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-229983d9-9400-459d-85e8-9ada1d6ab62e tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-508a214c-9fa4-4697-ae8a-66d3b40f503b-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:16 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:33:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:33:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:33:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] Creating offline snapshot 7767f1fe-aeea-4e24-b3ad-e938df18629a of volume 4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:33:17 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e0aaeb-9604-4733-8aab-5c4bd3c262bd]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:33:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:17 devstack quobyte-client[83219]: System call of process 89153 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:33:17 devstack quobyte-client[83219]: System call of process 89153 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:33:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e" returned: 0 in 0.741s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b788453-14c5-46e0-986a-21391f20d2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:33:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:18 devstack quobyte-client[83219]: System call of process 89156 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:33:18 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=28, name=volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:33:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a 1G" returned: 0 in 0.463s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] CMD "qemu-img rebase -u -b volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a" returned: 0 in 0.188s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:33:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a" returned: 0 in 0.151s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:33:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a" returned: 0 in 0.150s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.104s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:33:19 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-7d0d6598-530a-45e6-b7ef-8404538afc1f tempest-SnapshotsActionsTest-476714385 None] Create snapshot completed successfully Sep 17 07:33:20 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Acquiring lock "cinder-7767f1fe-aeea-4e24-b3ad-e938df18629a-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:20 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-7767f1fe-aeea-4e24-b3ad-e938df18629a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.104s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:20 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:33:20 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Acquiring lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:20 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:20 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Acquiring lock "cinder-quobyte-7767f1fe-aeea-4e24-b3ad-e938df18629a" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-7767f1fe-aeea-4e24-b3ad-e938df18629a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:21 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Deleting offline snapshot 7767f1fe-aeea-4e24-b3ad-e938df18629a of volume 4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:33:21 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] snapshot_file for this snap is: volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:33:21 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0532b12d-9b97-4488-b8f3-b0e2fedc2318]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:33:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a" returned: 0 in 0.930s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b788453-14c5-46e0-986a-21391f20d2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:33:22 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[90711480-2602-4fbb-b226-2bf1ad8bda5f]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:33:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:22 devstack quobyte-client[83219]: System call of process 89170 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:33:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e" returned: 0 in 0.507s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b788453-14c5-46e0-986a-21391f20d2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:33:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:22 devstack quobyte-client[83219]: System call of process 89173 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:33:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a" returned: 0 in 0.393s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.7767f1fe-aeea-4e24-b3ad-e938df18629a" returned: 0 in 0.296s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:23 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-7767f1fe-aeea-4e24-b3ad-e938df18629a" released by "_delete_snapshot" :: held 2.595s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:23 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" released by "delete_snapshot" :: held 2.628s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:24 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Created reservations ['c514b79f-8084-461d-8dc2-f94c98a5d828', '3557b0a3-9e88-4ae7-aa78-587448cd56ea', '8df33570-3ba1-4732-bdbe-6b4bc9e72215', '86520d3d-387f-45cd-ae10-180b8fdfd23b'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:33:24 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Delete snapshot completed successfully. Sep 17 07:33:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c5c4770-1ba0-40d6-ac74-0c92e66d9e6c tempest-SnapshotsActionsTest-329726972 None] Lock "cinder-7767f1fe-aeea-4e24-b3ad-e938df18629a-delete_snapshot" released by "delete_snapshot" :: held 3.281s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Acquiring lock "cinder-280d7d74-c3a0-4080-bc94-9e9f86b1e64e-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Lock "cinder-280d7d74-c3a0-4080-bc94-9e9f86b1e64e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:26 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:33:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Acquiring lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" acquired by "delete_snapshot" :: waited 0.039s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Acquiring lock "cinder-quobyte-280d7d74-c3a0-4080-bc94-9e9f86b1e64e" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Lock "cinder-quobyte-280d7d74-c3a0-4080-bc94-9e9f86b1e64e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Deleting offline snapshot 280d7d74-c3a0-4080-bc94-9e9f86b1e64e of volume 4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:33:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] snapshot_file for this snap is: volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:33:26 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[409d6f24-2729-4d2f-951a-6d123a42c53f]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:33:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:26 devstack quobyte-client[83219]: System call of process 89178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:33:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e" returned: 0 in 0.590s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b788453-14c5-46e0-986a-21391f20d2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:33:26 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[97baadeb-00a9-45d6-8417-17137c545997]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:33:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:33:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:33:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:33:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:33:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:33:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:33:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.218s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:33:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab" returned: 0 in 0.886s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e" returned: 0 in 0.317s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab.280d7d74-c3a0-4080-bc94-9e9f86b1e64e" returned: 0 in 0.186s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Lock "cinder-quobyte-280d7d74-c3a0-4080-bc94-9e9f86b1e64e" released by "_delete_snapshot" :: held 2.516s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" released by "delete_snapshot" :: held 2.554s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:28 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=59,cinder:SELECT=61,cinder:DELETE=7,cinder:INSERT=14 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:33:29 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=54,cinder:UPDATE=87,cinder:DELETE=6,cinder:INSERT=22 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:33:29 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Created reservations ['2f60b731-95d1-4637-8b2f-3e96b8140508', 'e34acf6b-31d0-494c-aa3d-ea40263626de', '896fa827-ab2e-4c90-a3bd-6b29dcaab28f', '5464b6d7-751d-4e22-945b-a67a034576df'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:33:29 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Delete snapshot completed successfully. Sep 17 07:33:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b034b9fc-efe1-4ac9-9b96-26eb54876152 tempest-SnapshotsActionsTest-476714385 None] Lock "cinder-280d7d74-c3a0-4080-bc94-9e9f86b1e64e-delete_snapshot" released by "delete_snapshot" :: held 3.486s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:30 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Acquiring lock "cinder-4b788453-14c5-46e0-986a-21391f20d2ab-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:30 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Lock "cinder-4b788453-14c5-46e0-986a-21391f20d2ab-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:30 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:33:30 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Acquiring lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:33:30 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" acquired by "delete_volume" :: waited 0.025s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:33:30 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[332cfaa9-af09-43ba-87cc-76e4ff4da0a4]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:33:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab" returned: 0 in 0.535s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4b788453-14c5-46e0-986a-21391f20d2ab" returned: 0 in 0.214s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Lock "cinder-quobyte-4b788453-14c5-46e0-986a-21391f20d2ab" released by "delete_volume" :: held 1.157s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:32 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Created reservations ['60021f78-6f91-40b9-a711-194299226846', '125be07b-d3aa-49da-a4d1-8141415f39c7', '03d06b0f-3055-46c7-9515-dacb83cde7d4', 'aaf386df-eac4-474b-81a2-d16fb1c93bff'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:33:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:33:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:33:32 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:33:32 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:33:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:33:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.213s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:33 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:33:33 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Deleted volume successfully. Sep 17 07:33:33 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e235eebf-d787-49a1-b259-17f0390eb476 tempest-SnapshotsActionsTest-476714385 None] Lock "cinder-4b788453-14c5-46e0-986a-21391f20d2ab-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:33:42 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=11,cinder:INSERT=6,cinder:UPDATE=15 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:33:43 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=12,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:33:58 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:33:58 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Flow 'volume_create_manager' (d3ec6f36-fd3c-4819-b4fa-f471dd0d88fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abfe9418-9ef3-4739-a7d6-4d43d556418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abfe9418-9ef3-4739-a7d6-4d43d556418f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1962617622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711b0166-1008-4fe0-8688-3b9aac628112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a1a99da8534847ad9d7739205709a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:33:59Z,use_quota=True,user_id='54101366051c4b99a32e8c3e08087d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d6ff25-31d8-47a4-8e2f-96dd159a35d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d6ff25-31d8-47a4-8e2f-96dd159a35d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2b5688-f800-4c41-a3b7-7be2aeb4cb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df2b5688-f800-4c41-a3b7-7be2aeb4cb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711b0166-1008-4fe0-8688-3b9aac628112', 'volume_name': 'volume-711b0166-1008-4fe0-8688-3b9aac628112', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (593ff50e-8233-4b4d-81f0-63cd7112c3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (593ff50e-8233-4b4d-81f0-63cd7112c3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595af5a8-0a0f-4ea7-be7d-b556484f087c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:33:59 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Volume 711b0166-1008-4fe0-8688-3b9aac628112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711b0166-1008-4fe0-8688-3b9aac628112', 'volume_size': 1} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1962617622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711b0166-1008-4fe0-8688-3b9aac628112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a1a99da8534847ad9d7739205709a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:33:59Z,use_quota=True,user_id='54101366051c4b99a32e8c3e08087d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Creating volume 711b0166-1008-4fe0-8688-3b9aac628112 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:33:59 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-711b0166-1008-4fe0-8688-3b9aac628112 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:59 devstack quobyte-client[83219]: System call of process 89264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:33:59 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=29, name=volume-711b0166-1008-4fe0-8688-3b9aac628112, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-711b0166-1008-4fe0-8688-3b9aac628112 1073741824" returned: 0 in 0.511s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-711b0166-1008-4fe0-8688-3b9aac628112 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-711b0166-1008-4fe0-8688-3b9aac628112" returned: 0 in 0.135s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] <== create_volume: return (734ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:33:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:34:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595af5a8-0a0f-4ea7-be7d-b556484f087c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711b0166-1008-4fe0-8688-3b9aac628112', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:34:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a106de7-a4de-4182-81c8-117c8519cf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:34:00 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Volume volume-711b0166-1008-4fe0-8688-3b9aac628112 (711b0166-1008-4fe0-8688-3b9aac628112): created successfully Sep 17 07:34:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a106de7-a4de-4182-81c8-117c8519cf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:34:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Flow 'volume_create_manager' (d3ec6f36-fd3c-4819-b4fa-f471dd0d88fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:34:00 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-aed39601-0905-4f10-98bc-f2cf638eb672 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Created volume successfully. Sep 17 07:34:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Acquiring lock "cinder-711b0166-1008-4fe0-8688-3b9aac628112-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:34:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Lock "cinder-711b0166-1008-4fe0-8688-3b9aac628112-delete_volume" acquired by "delete_volume" :: waited 0.395s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:34:05 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:34:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Acquiring lock "cinder-quobyte-711b0166-1008-4fe0-8688-3b9aac628112" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:34:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Lock "cinder-quobyte-711b0166-1008-4fe0-8688-3b9aac628112" acquired by "delete_volume" :: waited 0.022s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:34:05 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a19cda-1478-46c8-9cbd-30a499c1eec4]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:34:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-711b0166-1008-4fe0-8688-3b9aac628112 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:07 devstack quobyte-client[83219]: System call of process 89335 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:34:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-711b0166-1008-4fe0-8688-3b9aac628112" returned: 0 in 1.637s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-711b0166-1008-4fe0-8688-3b9aac628112 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-711b0166-1008-4fe0-8688-3b9aac628112" returned: 0 in 0.654s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:08 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Lock "cinder-quobyte-711b0166-1008-4fe0-8688-3b9aac628112" released by "delete_volume" :: held 3.102s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:34:09 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Created reservations ['65e12c5c-99dd-4e9e-9764-2e089cfe33b7', 'a3326e05-28c3-4202-a443-3c8574adcac4', '1946ae9d-1897-4648-b36a-df334c9e2c83', 'd85daa15-d232-4c24-ba2a-6f4df4f0c39a'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:34:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.041s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:34:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:34:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:34:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:34:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.131s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:10 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:34:10 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Deleted volume successfully. Sep 17 07:34:10 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0d30e25a-3c2f-441e-817f-87fd100d3b17 tempest-VolumeQuotasNegativeTestJSON-2077850061 None] Lock "cinder-711b0166-1008-4fe0-8688-3b9aac628112-delete_volume" released by "delete_volume" :: held 5.453s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:34:19 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:34:20 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=9,cinder:SELECT=6,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:34:24 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:34:24 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:34:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Flow 'volume_create_manager' (ca3026b5-fcb3-495a-b62a-e2e9d7f616ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:34:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c128599a-804d-4198-a52b-bce39cb8f930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:34:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c128599a-804d-4198-a52b-bce39cb8f930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-649945421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8203469d7e0c4f3daabc90cc26e7467d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:34:24Z,use_quota=True,user_id='e15933f66cf649669bb1d23751dc4503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:34:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e121cc87-4f64-4408-8f15-616bfb436aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e121cc87-4f64-4408-8f15-616bfb436aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43548acd-615c-4c42-9789-b5c13c1598de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43548acd-615c-4c42-9789-b5c13c1598de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1', 'volume_name': 'volume-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af1f11d-b748-4c7b-8fe9-59c8775dddd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af1f11d-b748-4c7b-8fe9-59c8775dddd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5afc2f-2332-482d-8d9e-236fd6f19815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:34:25 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Volume 6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1', 'volume_size': 1} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-649945421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8203469d7e0c4f3daabc90cc26e7467d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:34:24Z,use_quota=True,user_id='e15933f66cf649669bb1d23751dc4503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Creating volume 6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:34:25 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:25 devstack quobyte-client[83219]: System call of process 89449 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:34:25 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=30, name=volume-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1 1073741824" returned: 0 in 0.490s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1" returned: 0 in 0.123s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] <== create_volume: return (700ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:34:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:34:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5afc2f-2332-482d-8d9e-236fd6f19815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:34:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1760af9c-4afe-42ed-8595-327347a929e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:34:26 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Volume volume-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1 (6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1): created successfully Sep 17 07:34:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1760af9c-4afe-42ed-8595-327347a929e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:34:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Flow 'volume_create_manager' (ca3026b5-fcb3-495a-b62a-e2e9d7f616ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:34:26 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-6a23d8a3-bc53-4da9-83dc-ed1d4693ac59 tempest-VolumesServicesTestJSON-854461663 None] Created volume successfully. Sep 17 07:34:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:34:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:34:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:34:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:34:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:34:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:34:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.171s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:34:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Acquiring lock "cinder-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:34:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Lock "cinder-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1-delete_volume" acquired by "delete_volume" :: waited 0.212s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:34:28 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:34:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Acquiring lock "cinder-quobyte-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:34:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Lock "cinder-quobyte-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1" acquired by "delete_volume" :: waited 0.040s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:34:28 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c120b26-5ed9-46e9-9ed8-677a9fb81b66]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:34:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1" returned: 0 in 0.850s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1" returned: 0 in 0.253s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:30 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Lock "cinder-quobyte-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1" released by "delete_volume" :: held 1.490s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:34:30 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Created reservations ['078aefc1-43e6-44c0-9c26-1c8efbe5b76a', '566b8192-4460-4401-89c8-b45af72e6f3c', '1ccd54a5-6b76-42d3-89d6-538bbc96698c', 'd62a139a-07a5-43ab-a0c9-082f66274563'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:34:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:34:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:34:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:34:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:34:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.389s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:31 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:34:31 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Deleted volume successfully. Sep 17 07:34:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-719b3082-2234-467a-bc17-5bfd4e90848e tempest-VolumesServicesTestJSON-854461663 None] Lock "cinder-6ca995c4-e6c7-41fd-a2a3-3b4daaa746b1-delete_volume" released by "delete_volume" :: held 4.290s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=9,cinder:DELETE=1,cinder:SELECT=6,cinder:INSERT=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:34:41 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Flow 'volume_create_manager' (eaca2bb8-c03c-4fd7-833a-fac2bcd281fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c31f37c-5d48-477c-ab9d-b4f3d429c650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c31f37c-5d48-477c-ab9d-b4f3d429c650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-305065894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542f2d0e-73ca-4d13-8e1a-29f6c5ffc725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c98066f6e146f19ca26141e71578db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:34:41Z,use_quota=True,user_id='1a8c1ff7d19047d1921e1bfcbeba57a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cefe156-a89a-4e94-a33f-ff1648efbf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cefe156-a89a-4e94-a33f-ff1648efbf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a26546-c2c4-4093-b760-b790cd62257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a26546-c2c4-4093-b760-b790cd62257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '542f2d0e-73ca-4d13-8e1a-29f6c5ffc725', 'volume_name': 'volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31aec6a0-ae1b-4e65-8969-a8a1b930684f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31aec6a0-ae1b-4e65-8969-a8a1b930684f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f379c5-3de4-49f1-b80d-2c2bbccea677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:34:41 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Volume 542f2d0e-73ca-4d13-8e1a-29f6c5ffc725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725', 'volume_size': 1} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-305065894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542f2d0e-73ca-4d13-8e1a-29f6c5ffc725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81c98066f6e146f19ca26141e71578db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:34:41Z,use_quota=True,user_id='1a8c1ff7d19047d1921e1bfcbeba57a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Creating volume 542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:34:41 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:34:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:42 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=31, name=volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:34:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 1073741824" returned: 0 in 0.380s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725" returned: 0 in 0.120s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] <== create_volume: return (614ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:34:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.628s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:34:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f379c5-3de4-49f1-b80d-2c2bbccea677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:34:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42316c3-c254-477e-b72b-32bdb24ffbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:34:42 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Volume volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 (542f2d0e-73ca-4d13-8e1a-29f6c5ffc725): created successfully Sep 17 07:34:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42316c3-c254-477e-b72b-32bdb24ffbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:34:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Flow 'volume_create_manager' (eaca2bb8-c03c-4fd7-833a-fac2bcd281fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:34:42 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-74273c19-7f31-4f3c-8a66-6fe9f456047c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Created volume successfully. Sep 17 07:34:44 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:34:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:34:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:34:44 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Creating offline snapshot f1f1aca4-3c19-41aa-81a5-c700aca4da7b of volume 542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:34:44 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c607ab-9592-4386-8484-f474421cfcd5]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:34:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:45 devstack quobyte-client[83219]: System call of process 89486 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:34:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725" returned: 0 in 0.873s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:45 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=32, name=volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:34:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b 1G" returned: 0 in 0.491s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): qemu-img rebase -u -b volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "qemu-img rebase -u -b volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b" returned: 0 in 0.168s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:34:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b" returned: 0 in 0.194s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:34:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b" returned: 0 in 0.146s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.info" returned: 0 in 0.148s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:34:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.info" returned: 0 in 0.097s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.593s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:34:47 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-45bae4ac-b4cd-4555-8f31-4ef34a40e20c tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Create snapshot completed successfully Sep 17 07:34:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Acquiring lock "cinder-f1f1aca4-3c19-41aa-81a5-c700aca4da7b-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:34:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "cinder-f1f1aca4-3c19-41aa-81a5-c700aca4da7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.121s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:34:48 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:34:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Acquiring lock "cinder-quobyte-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:34:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "cinder-quobyte-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725" acquired by "delete_snapshot" :: waited 0.039s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:34:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Acquiring lock "cinder-quobyte-f1f1aca4-3c19-41aa-81a5-c700aca4da7b" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:34:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "cinder-quobyte-f1f1aca4-3c19-41aa-81a5-c700aca4da7b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:34:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Deleting offline snapshot f1f1aca4-3c19-41aa-81a5-c700aca4da7b of volume 542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:34:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] snapshot_file for this snap is: volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:34:48 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[95839c2e-b1b3-4b92-bcd4-15e951c0cd38]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:34:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:49 devstack quobyte-client[83219]: System call of process 89511 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:34:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b" returned: 0 in 1.468s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:34:50 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcab8c2-d56c-43eb-8a98-86320c3f2205]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:34:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725" returned: 0 in 0.823s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b" returned: 0 in 0.386s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725.f1f1aca4-3c19-41aa-81a5-c700aca4da7b" returned: 0 in 0.165s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "cinder-quobyte-f1f1aca4-3c19-41aa-81a5-c700aca4da7b" released by "_delete_snapshot" :: held 3.732s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:34:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "cinder-quobyte-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725" released by "delete_snapshot" :: held 3.781s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:34:52 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Created reservations ['d3ff8d7e-7556-4a99-beca-38e65e44a633', 'cc7b0bcb-95f8-4605-b5f7-539fb9c9c25c', '7e368018-0db4-4db1-b469-3fb79ddb4b06', '7e63af12-3fb7-46b3-ae81-b63a102fb204'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:52 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Delete snapshot completed successfully. Sep 17 07:34:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-48079565-f897-40de-8af8-67b79fd3d758 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "cinder-f1f1aca4-3c19-41aa-81a5-c700aca4da7b-delete_snapshot" released by "delete_snapshot" :: held 4.730s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:34:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Acquiring lock "cinder-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:34:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "cinder-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:34:54 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:34:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Acquiring lock "cinder-quobyte-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:34:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "cinder-quobyte-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725" acquired by "delete_volume" :: waited 0.067s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:34:54 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bfb2ca-93b4-4ae4-aa25-bd9fb60c3c3c]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:34:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:55 devstack quobyte-client[83219]: System call of process 89553 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:34:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725" returned: 0 in 0.926s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725" returned: 0 in 0.171s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "cinder-quobyte-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725" released by "delete_volume" :: held 1.485s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:34:56 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Created reservations ['2912046b-726a-47d2-892a-7901e476c2c4', '87ed86b3-6f80-453b-83cd-fa22b426fb94', '0eeec08a-e552-4ce9-9916-722537a2f66c', 'a5e6a052-b3fe-402c-b174-be016af86efa'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:34:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:34:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:34:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:34:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:34:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:34:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:34:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.221s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:34:57 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:34:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Deleted volume successfully. Sep 17 07:34:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-00b531aa-c7de-4808-a293-9f990cfed0d6 tempest-VolumeSnapshotQuotasNegativeTestJSON-914669162 None] Lock "cinder-542f2d0e-73ca-4d13-8e1a-29f6c5ffc725-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:35:05 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Flow 'volume_create_manager' (8ec2f189-1d1a-4edb-af29-d0f70b5ebb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8addcb2d-af11-434b-a6d5-ea06a72b51aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8addcb2d-af11-434b-a6d5-ea06a72b51aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-313584208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d5f583-eb9f-4a57-bf4f-22fb1dabc6de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d8d2d05d524b0cafcca3e748167ff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:35:05Z,use_quota=True,user_id='ea3e911a00134f0fb0bb9892438831bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8021a2c-eacf-4a14-a621-717fc8583c34),volume_type_id=b8021a2c-eacf-4a14-a621-717fc8583c34)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57b59f5-efb0-467c-8f8c-c76800379bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57b59f5-efb0-467c-8f8c-c76800379bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993e2e9f-1faa-4219-9fc2-ba28c1bb61e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993e2e9f-1faa-4219-9fc2-ba28c1bb61e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d5f583-eb9f-4a57-bf4f-22fb1dabc6de', 'volume_name': 'volume-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdb47e0-9e45-42c1-bd15-cbe5dc477c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdb47e0-9e45-42c1-bd15-cbe5dc477c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21dc759e-248d-41d8-98ae-834170839029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:05 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Volume 05d5f583-eb9f-4a57-bf4f-22fb1dabc6de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de', 'volume_size': 1} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-313584208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d5f583-eb9f-4a57-bf4f-22fb1dabc6de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77d8d2d05d524b0cafcca3e748167ff9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:35:05Z,use_quota=True,user_id='ea3e911a00134f0fb0bb9892438831bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8021a2c-eacf-4a14-a621-717fc8583c34),volume_type_id=b8021a2c-eacf-4a14-a621-717fc8583c34)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Creating volume 05d5f583-eb9f-4a57-bf4f-22fb1dabc6de {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:35:05 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:35:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:05 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=34, name=volume-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:35:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de 1073741824" returned: 0 in 0.520s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de" returned: 0 in 0.198s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] <== create_volume: return (794ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:35:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:35:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21dc759e-248d-41d8-98ae-834170839029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ce0e62-9bf8-4373-8ace-c0456d1695a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:06 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Volume volume-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de (05d5f583-eb9f-4a57-bf4f-22fb1dabc6de): created successfully Sep 17 07:35:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ce0e62-9bf8-4373-8ace-c0456d1695a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Flow 'volume_create_manager' (8ec2f189-1d1a-4edb-af29-d0f70b5ebb36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:35:06 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-103baa0c-39f7-42b2-b74b-1844983a3a71 tempest-VolumeTypesAccessTest-1797629356 None] Created volume successfully. Sep 17 07:35:07 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Acquiring lock "cinder-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:35:07 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Lock "cinder-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:35:07 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:35:07 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Acquiring lock "cinder-quobyte-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:35:07 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Lock "cinder-quobyte-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de" acquired by "delete_volume" :: waited 0.015s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:35:08 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f308dbf-8007-4ea8-bce8-e5abe46aed23]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:35:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de" returned: 0 in 0.687s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de" returned: 0 in 0.113s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:08 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Lock "cinder-quobyte-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de" released by "delete_volume" :: held 1.010s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:35:09 devstack cinder-volume[83207]: WARNING cinder.quota [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1042978295 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1042978295, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:35:09 devstack cinder-volume[83207]: WARNING cinder.quota [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1042978295 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1042978295, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:35:09 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Created reservations ['afdb5bca-7e1d-42d1-b49d-12ba23e0a876', '560e805a-ea08-4d6a-a880-bec4a6e9b62a', '8120ea34-8c4d-4406-b9df-92d04c865556', 'b6b72805-3b9e-48fe-aea3-413dd6d3ba09'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:35:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:35:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:35:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:35:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:35:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.129s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:09 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:35:09 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Deleted volume successfully. Sep 17 07:35:10 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5a7ce501-c56e-4eb7-9abf-d98b2bb7ab64 tempest-VolumeTypesAccessTest-1797629356 None] Lock "cinder-05d5f583-eb9f-4a57-bf4f-22fb1dabc6de-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:35:18 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Flow 'volume_create_manager' (9495d8d2-5605-4140-9cfe-352850dc429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1da7e7-0637-4cb3-b451-270bb5d14bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1da7e7-0637-4cb3-b451-270bb5d14bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2141518811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d457f6-21f2-4293-a723-9beef760caa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d0945f219d45c8bb41b97ae21ee650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:35:18Z,use_quota=True,user_id='9a203994d5604eb59e3d8e5324626746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4989d11b-bb51-4ef4-8311-d95a6df3ab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4989d11b-bb51-4ef4-8311-d95a6df3ab8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b7ed3d-578c-4990-a1a0-f508652c9004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b7ed3d-578c-4990-a1a0-f508652c9004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d457f6-21f2-4293-a723-9beef760caa4', 'volume_name': 'volume-91d457f6-21f2-4293-a723-9beef760caa4', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f939db1c-ee31-451c-9c0d-5e78bd559515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f939db1c-ee31-451c-9c0d-5e78bd559515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543c399e-6522-4069-b169-b8aa17a98449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:18 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Volume 91d457f6-21f2-4293-a723-9beef760caa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d457f6-21f2-4293-a723-9beef760caa4', 'volume_size': 1} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2141518811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d457f6-21f2-4293-a723-9beef760caa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d0945f219d45c8bb41b97ae21ee650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:35:18Z,use_quota=True,user_id='9a203994d5604eb59e3d8e5324626746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Creating volume 91d457f6-21f2-4293-a723-9beef760caa4 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:35:18 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:35:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91d457f6-21f2-4293-a723-9beef760caa4 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:18 devstack quobyte-client[83219]: System call of process 89628 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:35:18 devstack quobyte-client[83219]: System call of process 89628 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:35:18 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=35, name=volume-91d457f6-21f2-4293-a723-9beef760caa4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:35:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91d457f6-21f2-4293-a723-9beef760caa4 1073741824" returned: 0 in 0.607s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91d457f6-21f2-4293-a723-9beef760caa4 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:19 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=24,cinder:SELECT=17,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:35:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91d457f6-21f2-4293-a723-9beef760caa4" returned: 0 in 0.275s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:19 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] <== create_volume: return (942ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:35:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:35:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543c399e-6522-4069-b169-b8aa17a98449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d457f6-21f2-4293-a723-9beef760caa4', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9edbeb00-b403-4836-ac33-a263cd1ff003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:20 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Volume volume-91d457f6-21f2-4293-a723-9beef760caa4 (91d457f6-21f2-4293-a723-9beef760caa4): created successfully Sep 17 07:35:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9edbeb00-b403-4836-ac33-a263cd1ff003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Flow 'volume_create_manager' (9495d8d2-5605-4140-9cfe-352850dc429e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:35:20 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e07d7cd9-0012-41d2-93e9-4dbd9efd1da8 tempest-AttachVolumeShelveTestJSON-766742006 None] Created volume successfully. Sep 17 07:35:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:35:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:35:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:35:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:35:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:35:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:35:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.620s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:35:30 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=27,cinder:UPDATE=44,cinder:DELETE=6,cinder:INSERT=9 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:35:39 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Flow 'volume_create_manager' (e7ecaadf-2a9c-4c28-a2bd-1dd11b26d35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af9c68c-d913-4e00-84b7-40ff06ec3e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af9c68c-d913-4e00-84b7-40ff06ec3e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-55899953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45679c1c-1139-4091-8eb3-0eaf461e19ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f01088e632e413e86d9b59e10245140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:35:39Z,use_quota=True,user_id='6133dc4485ac417184098fafc84af9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0319bda7-ae81-4aa1-b427-d95b31f78500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0319bda7-ae81-4aa1-b427-d95b31f78500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6408d13d-b89c-41be-9f55-fd5bf26b5fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6408d13d-b89c-41be-9f55-fd5bf26b5fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45679c1c-1139-4091-8eb3-0eaf461e19ba', 'volume_name': 'volume-45679c1c-1139-4091-8eb3-0eaf461e19ba', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1574ac8-1e0f-4d2e-95e2-86de78a5d66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1574ac8-1e0f-4d2e-95e2-86de78a5d66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6581cf89-4915-4158-add1-95a0ef97ee55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:39 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Volume 45679c1c-1139-4091-8eb3-0eaf461e19ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45679c1c-1139-4091-8eb3-0eaf461e19ba', 'volume_size': 1} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-55899953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45679c1c-1139-4091-8eb3-0eaf461e19ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f01088e632e413e86d9b59e10245140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:35:39Z,use_quota=True,user_id='6133dc4485ac417184098fafc84af9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Creating volume 45679c1c-1139-4091-8eb3-0eaf461e19ba {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:35:39 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:35:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-45679c1c-1139-4091-8eb3-0eaf461e19ba 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:39 devstack quobyte-client[83219]: System call of process 89719 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:35:39 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=36, name=volume-45679c1c-1139-4091-8eb3-0eaf461e19ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:35:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-45679c1c-1139-4091-8eb3-0eaf461e19ba 1073741824" returned: 0 in 0.596s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-45679c1c-1139-4091-8eb3-0eaf461e19ba {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-45679c1c-1139-4091-8eb3-0eaf461e19ba" returned: 0 in 0.239s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] <== create_volume: return (1037ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:35:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:35:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6581cf89-4915-4158-add1-95a0ef97ee55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45679c1c-1139-4091-8eb3-0eaf461e19ba', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67210906-d591-4538-b751-09c215ddf513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:41 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Volume volume-45679c1c-1139-4091-8eb3-0eaf461e19ba (45679c1c-1139-4091-8eb3-0eaf461e19ba): created successfully Sep 17 07:35:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67210906-d591-4538-b751-09c215ddf513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Flow 'volume_create_manager' (e7ecaadf-2a9c-4c28-a2bd-1dd11b26d35e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:35:41 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5133f20c-6145-4a78-97c0-a73d73e33e19 tempest-AttachVolumeTestJSON-36775929 None] Created volume successfully. Sep 17 07:35:45 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Flow 'volume_create_manager' (f0e230a8-46e2-42e5-bc06-cb7de812c421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2affb7-401a-45fe-a363-789cb8fcc1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2affb7-401a-45fe-a363-789cb8fcc1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-135140261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685dc50b-1a6d-4261-b831-3c30d3007925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fb64f6540343c1b63357fb369422be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:35:45Z,use_quota=True,user_id='4bfc17472ea24545827bb805d9d27551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59176f8-a3ca-4f3b-b2c1-84b6b8117f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59176f8-a3ca-4f3b-b2c1-84b6b8117f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a422e096-be2e-457a-90b4-db361edf4b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a422e096-be2e-457a-90b4-db361edf4b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685dc50b-1a6d-4261-b831-3c30d3007925', 'volume_name': 'volume-685dc50b-1a6d-4261-b831-3c30d3007925', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd32d0f-46c1-4095-8b0f-dc6b0f948eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd32d0f-46c1-4095-8b0f-dc6b0f948eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ea1b7d-fdc0-41ab-b0dd-332f7fbdc5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:45 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Volume 685dc50b-1a6d-4261-b831-3c30d3007925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685dc50b-1a6d-4261-b831-3c30d3007925', 'volume_size': 1} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-135140261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685dc50b-1a6d-4261-b831-3c30d3007925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64fb64f6540343c1b63357fb369422be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:35:45Z,use_quota=True,user_id='4bfc17472ea24545827bb805d9d27551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Creating volume 685dc50b-1a6d-4261-b831-3c30d3007925 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:35:45 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:45 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=37, name=volume-685dc50b-1a6d-4261-b831-3c30d3007925, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925 1073741824" returned: 0 in 0.491s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925" returned: 0 in 0.232s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] <== create_volume: return (806ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:35:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:35:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ea1b7d-fdc0-41ab-b0dd-332f7fbdc5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685dc50b-1a6d-4261-b831-3c30d3007925', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581bed94-b94c-4b6d-9c4e-1408b9608681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:35:46 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Volume volume-685dc50b-1a6d-4261-b831-3c30d3007925 (685dc50b-1a6d-4261-b831-3c30d3007925): created successfully Sep 17 07:35:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581bed94-b94c-4b6d-9c4e-1408b9608681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:35:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Flow 'volume_create_manager' (f0e230a8-46e2-42e5-bc06-cb7de812c421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:35:46 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-dcf4a585-5aed-4924-bbb6-62886e194947 tempest-SnapshotMetadataTestJSON-1161902906 None] Created volume successfully. Sep 17 07:35:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-05670ec0-4bce-4f96-81c9-a92b454c3753 req-d5e3de8f-5233-4405-a8ec-00595e4d53c8 tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:35:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-05670ec0-4bce-4f96-81c9-a92b454c3753 req-d5e3de8f-5233-4405-a8ec-00595e4d53c8 tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:35:47 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c257f5-8592-4173-a0db-953014e50171]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:35:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-05670ec0-4bce-4f96-81c9-a92b454c3753 req-d5e3de8f-5233-4405-a8ec-00595e4d53c8 tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-45679c1c-1139-4091-8eb3-0eaf461e19ba {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-05670ec0-4bce-4f96-81c9-a92b454c3753 req-d5e3de8f-5233-4405-a8ec-00595e4d53c8 tempest-AttachVolumeTestJSON-36775929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-45679c1c-1139-4091-8eb3-0eaf461e19ba" returned: 0 in 0.610s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-05670ec0-4bce-4f96-81c9-a92b454c3753 req-d5e3de8f-5233-4405-a8ec-00595e4d53c8 tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.703s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:35:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-05670ec0-4bce-4f96-81c9-a92b454c3753 req-d5e3de8f-5233-4405-a8ec-00595e4d53c8 tempest-AttachVolumeTestJSON-36775929 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-45679c1c-1139-4091-8eb3-0eaf461e19ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db8bef79-ff06-470f-9a11-e3f4ad9c8421', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:35:48 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-05670ec0-4bce-4f96-81c9-a92b454c3753 req-d5e3de8f-5233-4405-a8ec-00595e4d53c8 tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:35:48 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:35:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:35:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:35:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] Creating offline snapshot dc1bfa73-7e43-4e54-a14f-2b46ec2c3318 of volume 685dc50b-1a6d-4261-b831-3c30d3007925 {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:35:48 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec32172-0025-4bae-b005-45d9a22dbb5e]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:35:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:48 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-05670ec0-4bce-4f96-81c9-a92b454c3753 req-d5e3de8f-5233-4405-a8ec-00595e4d53c8 tempest-AttachVolumeTestJSON-36775929 None] attachment_update completed successfully. Sep 17 07:35:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925" returned: 0 in 0.735s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:49 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=38, name=volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:35:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318 1G" returned: 0 in 0.432s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): qemu-img rebase -u -b volume-685dc50b-1a6d-4261-b831-3c30d3007925 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:49 devstack quobyte-client[83219]: System call of process 89770 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:35:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "qemu-img rebase -u -b volume-685dc50b-1a6d-4261-b831-3c30d3007925 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318" returned: 0 in 0.236s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:35:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318" returned: 0 in 0.295s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:50 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925 -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:35:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318" returned: 0 in 0.209s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.info" returned: 0 in 0.216s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:50 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:35:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.info" returned: 0 in 0.179s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.811s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:35:51 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-f8a27db7-49af-4534-afe2-86f41ebeee3e tempest-SnapshotMetadataTestJSON-1161902906 None] Create snapshot completed successfully Sep 17 07:35:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Acquiring lock "cinder-dc1bfa73-7e43-4e54-a14f-2b46ec2c3318-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:35:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "cinder-dc1bfa73-7e43-4e54-a14f-2b46ec2c3318-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:35:54 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:35:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Acquiring lock "cinder-quobyte-685dc50b-1a6d-4261-b831-3c30d3007925" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:35:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "cinder-quobyte-685dc50b-1a6d-4261-b831-3c30d3007925" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:35:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Acquiring lock "cinder-quobyte-dc1bfa73-7e43-4e54-a14f-2b46ec2c3318" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:35:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "cinder-quobyte-dc1bfa73-7e43-4e54-a14f-2b46ec2c3318" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:35:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Deleting offline snapshot dc1bfa73-7e43-4e54-a14f-2b46ec2c3318 of volume 685dc50b-1a6d-4261-b831-3c30d3007925 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:35:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] snapshot_file for this snap is: volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:35:54 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3561cd59-5058-4d20-abc1-65946b1ed618]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:35:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318" returned: 0 in 0.723s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-685dc50b-1a6d-4261-b831-3c30d3007925(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:35:54 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d785af4b-0c1a-4cfa-b582-fd824934ea2c]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:35:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925" returned: 0 in 0.693s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:55 devstack quobyte-client[83219]: System call of process 90198 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:35:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318" returned: 0 in 0.602s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-2a21a9d2-ad01-46b8-844c-1d60173df862 req-a049abd8-1b61-4973-972e-2d3f782ba241 tempest-AttachVolumeShelveTestJSON-766742006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:35:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-2a21a9d2-ad01-46b8-844c-1d60173df862 req-a049abd8-1b61-4973-972e-2d3f782ba241 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.020s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:35:56 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff4b1ae-062e-4fc2-ba35-8f0121f5acb3]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:35:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-2a21a9d2-ad01-46b8-844c-1d60173df862 req-a049abd8-1b61-4973-972e-2d3f782ba241 tempest-AttachVolumeShelveTestJSON-766742006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91d457f6-21f2-4293-a723-9beef760caa4 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:35:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925.dc1bfa73-7e43-4e54-a14f-2b46ec2c3318" returned: 0 in 0.557s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "cinder-quobyte-dc1bfa73-7e43-4e54-a14f-2b46ec2c3318" released by "_delete_snapshot" :: held 2.973s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:35:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "cinder-quobyte-685dc50b-1a6d-4261-b831-3c30d3007925" released by "delete_snapshot" :: held 3.013s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:35:57 devstack quobyte-client[83219]: System call of process 90202 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:35:57 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Created reservations ['2b97bfff-8870-42af-990b-8a9ddfe8c794', '8017910e-5d8f-4b8b-a659-02cfede45649', 'a7c1f202-2a4c-47b2-b991-2b12d570f1f2', 'fdb7dae4-ffb4-4df6-b587-b2de27843a28'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:35:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-2a21a9d2-ad01-46b8-844c-1d60173df862 req-a049abd8-1b61-4973-972e-2d3f782ba241 tempest-AttachVolumeShelveTestJSON-766742006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91d457f6-21f2-4293-a723-9beef760caa4" returned: 0 in 0.771s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:35:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-2a21a9d2-ad01-46b8-844c-1d60173df862 req-a049abd8-1b61-4973-972e-2d3f782ba241 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.884s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:35:57 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-2a21a9d2-ad01-46b8-844c-1d60173df862 req-a049abd8-1b61-4973-972e-2d3f782ba241 tempest-AttachVolumeShelveTestJSON-766742006 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-91d457f6-21f2-4293-a723-9beef760caa4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '666b1ee6-a62e-408d-9434-19cd1ae196e5', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:35:57 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-2a21a9d2-ad01-46b8-844c-1d60173df862 req-a049abd8-1b61-4973-972e-2d3f782ba241 tempest-AttachVolumeShelveTestJSON-766742006 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:35:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Delete snapshot completed successfully. Sep 17 07:35:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-020fbda6-0c58-426e-89ed-f3606895a65e tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "cinder-dc1bfa73-7e43-4e54-a14f-2b46ec2c3318-delete_snapshot" released by "delete_snapshot" :: held 3.766s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:35:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-2a21a9d2-ad01-46b8-844c-1d60173df862 req-a049abd8-1b61-4973-972e-2d3f782ba241 tempest-AttachVolumeShelveTestJSON-766742006 None] attachment_update completed successfully. Sep 17 07:35:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Acquiring lock "cinder-685dc50b-1a6d-4261-b831-3c30d3007925-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:35:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "cinder-685dc50b-1a6d-4261-b831-3c30d3007925-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:35:58 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:35:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Acquiring lock "cinder-quobyte-685dc50b-1a6d-4261-b831-3c30d3007925" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:35:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "cinder-quobyte-685dc50b-1a6d-4261-b831-3c30d3007925" acquired by "delete_volume" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:35:58 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[04351924-d125-4fe8-b145-9e1f125ef8eb]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:35:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925" returned: 0 in 1.619s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-685dc50b-1a6d-4261-b831-3c30d3007925" returned: 0 in 0.095s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "cinder-quobyte-685dc50b-1a6d-4261-b831-3c30d3007925" released by "delete_volume" :: held 1.913s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:36:00 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Created reservations ['30d1b3c6-1101-40bb-be3f-a2ed3c440f2b', '78927aae-5b1f-4ae7-b0d8-9bc82341729d', 'a73f85c8-9e6a-4179-87c8-4789b88c575f', '672950d6-cf8b-4e06-a3a4-e5db1b19a76c'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:36:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:36:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:36:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:36:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:36:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.105s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:01 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:36:01 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Deleted volume successfully. Sep 17 07:36:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ab38bfe6-82f2-4c86-a2a2-867512455371 tempest-SnapshotMetadataTestJSON-1161902906 None] Lock "cinder-685dc50b-1a6d-4261-b831-3c30d3007925-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:36:07 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Flow 'volume_create_manager' (5e9eef61-dc9a-4630-8066-964810d3bf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8634285-2c65-4c9b-812b-d0c4106f7d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8634285-2c65-4c9b-812b-d0c4106f7d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1023811456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c5f481-93b3-4927-bdd2-afa332828072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae82f9c094e43e9a14f4bb00f45d7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:36:07Z,use_quota=True,user_id='7d5c2e836e8d452b9a8e88d963b1a704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e56daf-60f9-4d28-834f-bfd474dbbe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e56daf-60f9-4d28-834f-bfd474dbbe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70280d89-0e45-4168-8143-af45275e9e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70280d89-0e45-4168-8143-af45275e9e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c5f481-93b3-4927-bdd2-afa332828072', 'volume_name': 'volume-53c5f481-93b3-4927-bdd2-afa332828072', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd426ff-b31b-4b96-b586-d2e2f9a2e163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd426ff-b31b-4b96-b586-d2e2f9a2e163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c553c25a-a052-4e2b-9e7f-889df9a16d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:07 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Volume 53c5f481-93b3-4927-bdd2-afa332828072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c5f481-93b3-4927-bdd2-afa332828072', 'volume_size': 1} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1023811456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c5f481-93b3-4927-bdd2-afa332828072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae82f9c094e43e9a14f4bb00f45d7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:36:07Z,use_quota=True,user_id='7d5c2e836e8d452b9a8e88d963b1a704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Creating volume 53c5f481-93b3-4927-bdd2-afa332828072 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:36:07 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:36:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-53c5f481-93b3-4927-bdd2-afa332828072 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:07 devstack quobyte-client[83219]: System call of process 90253 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:36:07 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=40, name=volume-53c5f481-93b3-4927-bdd2-afa332828072, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:36:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-53c5f481-93b3-4927-bdd2-afa332828072 1073741824" returned: 0 in 0.445s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-53c5f481-93b3-4927-bdd2-afa332828072 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-53c5f481-93b3-4927-bdd2-afa332828072" returned: 0 in 0.263s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] <== create_volume: return (819ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:36:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:36:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c553c25a-a052-4e2b-9e7f-889df9a16d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c5f481-93b3-4927-bdd2-afa332828072', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b9699a-f8bf-405d-ae76-2e19f8c22247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:08 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Volume volume-53c5f481-93b3-4927-bdd2-afa332828072 (53c5f481-93b3-4927-bdd2-afa332828072): created successfully Sep 17 07:36:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b9699a-f8bf-405d-ae76-2e19f8c22247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Flow 'volume_create_manager' (5e9eef61-dc9a-4630-8066-964810d3bf69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:36:09 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-33d2dab4-4828-432b-a646-6e132864c382 tempest-VolumesTransfersTest-1714154104 None] Created volume successfully. Sep 17 07:36:11 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5294b371-4b84-414f-8892-805e206605dc tempest-VolumesTransfersTest-14324024 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:36:11 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5294b371-4b84-414f-8892-805e206605dc tempest-VolumesTransfersTest-14324024 None] Transfer volume completed successfully. Sep 17 07:36:12 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Acquiring lock "cinder-53c5f481-93b3-4927-bdd2-afa332828072-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:36:12 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Lock "cinder-53c5f481-93b3-4927-bdd2-afa332828072-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:36:12 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:36:12 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Acquiring lock "cinder-quobyte-53c5f481-93b3-4927-bdd2-afa332828072" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:36:12 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Lock "cinder-quobyte-53c5f481-93b3-4927-bdd2-afa332828072" acquired by "delete_volume" :: waited 0.017s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:36:12 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bd6b5a-6a4f-482e-8da8-e9f372efb0e1]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:36:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-53c5f481-93b3-4927-bdd2-afa332828072 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-53c5f481-93b3-4927-bdd2-afa332828072" returned: 0 in 0.486s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-53c5f481-93b3-4927-bdd2-afa332828072 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-53c5f481-93b3-4927-bdd2-afa332828072" returned: 0 in 0.096s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:13 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Lock "cinder-quobyte-53c5f481-93b3-4927-bdd2-afa332828072" released by "delete_volume" :: held 0.766s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:36:13 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Created reservations ['8956d3a1-1722-44a2-9082-e05da5cf8edb', 'a9e7caf6-6894-402f-b974-d05ee5bbe408', 'ff11ec5e-4362-4529-8f95-57592ec168f5', 'e68ecc2e-31b4-42f1-ba18-2e3b64b4b686'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:36:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:36:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:36:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:36:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:36:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.170s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:14 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:36:14 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Deleted volume successfully. Sep 17 07:36:14 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-05eead9a-6063-409b-ac46-ed09ef3e000f tempest-VolumesTransfersTest-1888346269 None] Lock "cinder-53c5f481-93b3-4927-bdd2-afa332828072-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:36:15 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:36:15 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Flow 'volume_create_manager' (743506ab-6e3e-4337-9968-bd4fd52b4a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdadcec0-2804-4abc-ab67-cf9df53fce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdadcec0-2804-4abc-ab67-cf9df53fce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-877731859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c52a45-a459-4f31-b47e-d355fe6c26dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae82f9c094e43e9a14f4bb00f45d7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:36:16Z,use_quota=True,user_id='7d5c2e836e8d452b9a8e88d963b1a704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce069e7-3979-488d-b512-b37e3005a4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce069e7-3979-488d-b512-b37e3005a4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3786540b-0fa0-4a79-a0b1-bae4f8bac924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3786540b-0fa0-4a79-a0b1-bae4f8bac924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c52a45-a459-4f31-b47e-d355fe6c26dd', 'volume_name': 'volume-66c52a45-a459-4f31-b47e-d355fe6c26dd', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bdfd36-fe05-4b7d-9cf8-8bd6a9c3d4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bdfd36-fe05-4b7d-9cf8-8bd6a9c3d4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36dc88a3-3e9b-49f5-be42-9890389e072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:16 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Volume 66c52a45-a459-4f31-b47e-d355fe6c26dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c52a45-a459-4f31-b47e-d355fe6c26dd', 'volume_size': 1} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-877731859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c52a45-a459-4f31-b47e-d355fe6c26dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dae82f9c094e43e9a14f4bb00f45d7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:36:16Z,use_quota=True,user_id='7d5c2e836e8d452b9a8e88d963b1a704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Creating volume 66c52a45-a459-4f31-b47e-d355fe6c26dd {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:36:16 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66c52a45-a459-4f31-b47e-d355fe6c26dd 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:16 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=41, name=volume-66c52a45-a459-4f31-b47e-d355fe6c26dd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66c52a45-a459-4f31-b47e-d355fe6c26dd 1073741824" returned: 0 in 0.473s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66c52a45-a459-4f31-b47e-d355fe6c26dd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66c52a45-a459-4f31-b47e-d355fe6c26dd" returned: 0 in 0.284s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] <== create_volume: return (867ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:36:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:36:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36dc88a3-3e9b-49f5-be42-9890389e072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c52a45-a459-4f31-b47e-d355fe6c26dd', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64472aff-1574-4879-a729-c4a9e2a5c5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:17 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Volume volume-66c52a45-a459-4f31-b47e-d355fe6c26dd (66c52a45-a459-4f31-b47e-d355fe6c26dd): created successfully Sep 17 07:36:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64472aff-1574-4879-a729-c4a9e2a5c5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Flow 'volume_create_manager' (743506ab-6e3e-4337-9968-bd4fd52b4a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:36:17 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b3ef7b20-1201-4c97-8bdc-4657e16960a7 tempest-VolumesTransfersTest-1714154104 None] Created volume successfully. Sep 17 07:36:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Acquiring lock "cinder-66c52a45-a459-4f31-b47e-d355fe6c26dd-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:36:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Lock "cinder-66c52a45-a459-4f31-b47e-d355fe6c26dd-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:36:18 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:36:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Acquiring lock "cinder-quobyte-66c52a45-a459-4f31-b47e-d355fe6c26dd" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:36:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Lock "cinder-quobyte-66c52a45-a459-4f31-b47e-d355fe6c26dd" acquired by "delete_volume" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:36:18 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f621c3-3ebf-4e33-a2a1-e008c76ab9ff]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:36:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66c52a45-a459-4f31-b47e-d355fe6c26dd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66c52a45-a459-4f31-b47e-d355fe6c26dd" returned: 0 in 0.717s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66c52a45-a459-4f31-b47e-d355fe6c26dd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66c52a45-a459-4f31-b47e-d355fe6c26dd" returned: 0 in 0.221s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:20 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Lock "cinder-quobyte-66c52a45-a459-4f31-b47e-d355fe6c26dd" released by "delete_volume" :: held 1.585s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:36:20 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Created reservations ['5febc0da-b5db-4164-9972-b16912055177', '2628cc59-b146-403b-9345-5f46b37e074b', '0e53c112-1619-4292-8ebb-59bbfdba8817', '97779328-0d6c-4a83-883b-01e469c28d04'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:36:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:36:21 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:36:21 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:36:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:36:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.178s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:21 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:36:21 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Deleted volume successfully. Sep 17 07:36:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c888119a-0f1a-4475-a9be-077a437396e3 tempest-VolumesTransfersTest-1888346269 None] Lock "cinder-66c52a45-a459-4f31-b47e-d355fe6c26dd-delete_volume" released by "delete_volume" :: held 3.495s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:36:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:36:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:36:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:36:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:36:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:36:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:36:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.507s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:36:31 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=37,cinder:UPDATE=36,cinder:DELETE=1,cinder:INSERT=11 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:36:32 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=48,cinder:DELETE=7,cinder:SELECT=37,cinder:INSERT=5 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:36:38 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Flow 'volume_create_manager' (bd52fc31-aee4-4f56-9a64-b0e577fe72a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635c618d-208c-4db7-b600-da41f8949e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635c618d-208c-4db7-b600-da41f8949e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-194309070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d7478ab-9bdc-469f-8dbe-731f2cd97090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0885b6dcb0f14308a2171258110870d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:36:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:36:37Z,use_quota=True,user_id='c08607b5a4af4543a08af76dc26f2dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6455c8cb-c264-4454-b804-b07ddcaca1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6455c8cb-c264-4454-b804-b07ddcaca1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67753c5b-231f-4f15-8a8b-f8f201049625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67753c5b-231f-4f15-8a8b-f8f201049625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d7478ab-9bdc-469f-8dbe-731f2cd97090', 'volume_name': 'volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090', 'volume_size': 2}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52624565-7884-460e-8390-366530518771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52624565-7884-460e-8390-366530518771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f71fa5d-e665-49e3-919b-cd5d82cde74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:38 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Volume 0d7478ab-9bdc-469f-8dbe-731f2cd97090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090', 'volume_size': 2} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-194309070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d7478ab-9bdc-469f-8dbe-731f2cd97090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0885b6dcb0f14308a2171258110870d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:36:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:36:37Z,use_quota=True,user_id='c08607b5a4af4543a08af76dc26f2dbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Creating volume 0d7478ab-9bdc-469f-8dbe-731f2cd97090 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:36:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:36:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:36:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.208s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:36:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:36:39 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:36:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090 2147483648 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:39 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=42, name=volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:36:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090 2147483648" returned: 0 in 2.222s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090" returned: 0 in 0.171s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] <== create_volume: return (2678ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:36:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.693s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:36:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f71fa5d-e665-49e3-919b-cd5d82cde74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090', 'volume_size': 2}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ecdb98-f50a-49fe-8252-3937e0555cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:36:41 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Volume volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090 (0d7478ab-9bdc-469f-8dbe-731f2cd97090): created successfully Sep 17 07:36:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22ecdb98-f50a-49fe-8252-3937e0555cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:36:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Flow 'volume_create_manager' (bd52fc31-aee4-4f56-9a64-b0e577fe72a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:36:42 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-41c5e10f-f261-4707-820a-a60ec60d09fc tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Created volume successfully. Sep 17 07:36:43 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:36:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:36:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:36:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Creating offline snapshot 887ae22e-48c6-4017-9091-7f56aeff6a68 of volume 0d7478ab-9bdc-469f-8dbe-731f2cd97090 {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:36:43 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f566213d-0dc7-406c-9cf6-dd85b1a5eac0]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:36:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:44 devstack quobyte-client[83219]: System call of process 90918 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:36:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090" returned: 0 in 1.517s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68 2G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:45 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=43, name=volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:36:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68 2G" returned: 0 in 0.646s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:46 devstack quobyte-client[83219]: System call of process 90929 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:36:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "qemu-img rebase -u -b volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68" returned: 0 in 0.430s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:36:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68" returned: 0 in 0.240s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090 -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:36:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68" returned: 0 in 0.317s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.info" returned: 0 in 0.200s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:36:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.info" returned: 0 in 0.278s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.731s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:36:48 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5810b1e1-25da-4d7e-9f89-c2b4226fecc7 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Create snapshot completed successfully Sep 17 07:36:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Acquiring lock "cinder-887ae22e-48c6-4017-9091-7f56aeff6a68-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:36:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "cinder-887ae22e-48c6-4017-9091-7f56aeff6a68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:36:50 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:36:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Acquiring lock "cinder-quobyte-0d7478ab-9bdc-469f-8dbe-731f2cd97090" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:36:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "cinder-quobyte-0d7478ab-9bdc-469f-8dbe-731f2cd97090" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:36:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Acquiring lock "cinder-quobyte-887ae22e-48c6-4017-9091-7f56aeff6a68" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:36:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "cinder-quobyte-887ae22e-48c6-4017-9091-7f56aeff6a68" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:36:50 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Deleting offline snapshot 887ae22e-48c6-4017-9091-7f56aeff6a68 of volume 0d7478ab-9bdc-469f-8dbe-731f2cd97090 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:36:50 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] snapshot_file for this snap is: volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:36:50 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87a7b97-788d-462e-b510-8fc1ac21f5af]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:36:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68" returned: 0 in 0.484s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:50 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:36:50 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0b7040-ad6c-4000-b308-488192ce2f10]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:36:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:51 devstack quobyte-client[83219]: System call of process 90949 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:36:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090" returned: 0 in 0.621s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:51 devstack quobyte-client[83219]: System call of process 90954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:36:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68" returned: 0 in 0.631s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090.887ae22e-48c6-4017-9091-7f56aeff6a68" returned: 0 in 0.377s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "cinder-quobyte-887ae22e-48c6-4017-9091-7f56aeff6a68" released by "_delete_snapshot" :: held 2.837s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:36:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "cinder-quobyte-0d7478ab-9bdc-469f-8dbe-731f2cd97090" released by "delete_snapshot" :: held 2.893s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:36:54 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Created reservations ['0f60980b-1e72-4014-bdbf-91a292da7235', '1138ceb0-e187-456d-9e3a-e1e354dc90b1', '9e27e60b-efe4-42a2-a10e-70114b139eca', 'f7dd0d7b-2d76-45c9-af79-2b6784b1d78b'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:54 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Delete snapshot completed successfully. Sep 17 07:36:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3cce9d48-6aba-4e01-aa52-d45ad728823b tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "cinder-887ae22e-48c6-4017-9091-7f56aeff6a68-delete_snapshot" released by "delete_snapshot" :: held 4.349s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:36:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Acquiring lock "cinder-0d7478ab-9bdc-469f-8dbe-731f2cd97090-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:36:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "cinder-0d7478ab-9bdc-469f-8dbe-731f2cd97090-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:36:55 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:36:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Acquiring lock "cinder-quobyte-0d7478ab-9bdc-469f-8dbe-731f2cd97090" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:36:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "cinder-quobyte-0d7478ab-9bdc-469f-8dbe-731f2cd97090" acquired by "delete_volume" :: waited 0.032s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:36:55 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[68746e5a-e05a-40f8-a192-aab7ee55ecdd]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:36:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090" returned: 0 in 1.001s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0d7478ab-9bdc-469f-8dbe-731f2cd97090" returned: 0 in 0.247s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "cinder-quobyte-0d7478ab-9bdc-469f-8dbe-731f2cd97090" released by "delete_volume" :: held 1.718s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:36:57 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Created reservations ['f3fc5449-dea6-4570-b352-82eb9f2884d4', 'b59f246a-b92b-47da-8d93-a4c342d406f3', '8015f438-312f-4cc7-be05-9bae16369eff', '65ddd82c-bdcd-47b4-9e0c-8f643e67f09a'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:36:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:36:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:36:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:36:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:36:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:36:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:36:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.362s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:36:58 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:36:58 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Deleted volume successfully. Sep 17 07:36:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9117fdad-6912-468b-ba9c-fa513c725483 tempest-VolumesSnapshotNegativeTestJSON-1820254942 None] Lock "cinder-0d7478ab-9bdc-469f-8dbe-731f2cd97090-delete_volume" released by "delete_volume" :: held 4.278s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:37:07 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=10,cinder:UPDATE=16,cinder:DELETE=1,cinder:INSERT=5 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:37:09 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=17,cinder:SELECT=14,cinder:DELETE=2,cinder:INSERT=3 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:37:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:37:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:37:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:37:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:37:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:37:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:37:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:37:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.347s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:37:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:37:43 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Flow 'volume_create_manager' (9c655e05-6e9f-4393-bc34-3c6dc6ef797c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775fb53c-2a66-4e4e-b97d-93f2538a1bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775fb53c-2a66-4e4e-b97d-93f2538a1bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1665694107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b795d94-350c-42ff-83a9-56ba603821e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4cbdf49fe64a6f808d4ce1fabf7947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:37:43Z,use_quota=True,user_id='8ecc2cf53c874b5aa79f95897132a872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ccbc81-e3e6-495f-b438-4b1208c70dec),volume_type_id=51ccbc81-e3e6-495f-b438-4b1208c70dec)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225b687b-0643-44b8-bec3-265f86359c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225b687b-0643-44b8-bec3-265f86359c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538f92e7-0447-4096-99c8-31d5372cd8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538f92e7-0447-4096-99c8-31d5372cd8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b795d94-350c-42ff-83a9-56ba603821e5', 'volume_name': 'volume-5b795d94-350c-42ff-83a9-56ba603821e5', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d6d3d6-2e78-46a4-bae0-017df2bfda4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d6d3d6-2e78-46a4-bae0-017df2bfda4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823f00a8-13da-4047-8a2c-3f2e485366ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:43 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume 5b795d94-350c-42ff-83a9-56ba603821e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b795d94-350c-42ff-83a9-56ba603821e5', 'volume_size': 1} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1665694107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b795d94-350c-42ff-83a9-56ba603821e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4cbdf49fe64a6f808d4ce1fabf7947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:37:43Z,use_quota=True,user_id='8ecc2cf53c874b5aa79f95897132a872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ccbc81-e3e6-495f-b438-4b1208c70dec),volume_type_id=51ccbc81-e3e6-495f-b438-4b1208c70dec)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Creating volume 5b795d94-350c-42ff-83a9-56ba603821e5 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:37:43 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:37:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b795d94-350c-42ff-83a9-56ba603821e5 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:37:43 devstack quobyte-client[83219]: System call of process 91086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:37:43 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=45, name=volume-5b795d94-350c-42ff-83a9-56ba603821e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:37:44 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Flow 'volume_create_manager' (c11c8db1-de94-4f81-8b53-547731cf1243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67771651-cf51-48da-a961-178c01f5c8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b795d94-350c-42ff-83a9-56ba603821e5 1073741824" returned: 0 in 0.887s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b795d94-350c-42ff-83a9-56ba603821e5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67771651-cf51-48da-a961-178c01f5c8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1103349000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c83c436-52f6-452b-b2d6-95b7b82e08f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4cbdf49fe64a6f808d4ce1fabf7947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:37:43Z,use_quota=True,user_id='8ecc2cf53c874b5aa79f95897132a872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7dcad756-11f0-48df-ac79-55cc63413055),volume_type_id=7dcad756-11f0-48df-ac79-55cc63413055)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953f61a7-0464-4186-9aa5-e8a6e79b6b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953f61a7-0464-4186-9aa5-e8a6e79b6b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e84dba-b787-412f-aa16-a9ef7bc8e6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e84dba-b787-412f-aa16-a9ef7bc8e6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c83c436-52f6-452b-b2d6-95b7b82e08f4', 'volume_name': 'volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fdc57b-1848-42eb-83b2-00c1ca9812c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9fdc57b-1848-42eb-83b2-00c1ca9812c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c9b548-1dda-41da-aeb3-812665e46fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:44 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume 1c83c436-52f6-452b-b2d6-95b7b82e08f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4', 'volume_size': 1} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b795d94-350c-42ff-83a9-56ba603821e5" returned: 0 in 0.410s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] <== create_volume: return (1342ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:37:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.131s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1103349000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c83c436-52f6-452b-b2d6-95b7b82e08f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4cbdf49fe64a6f808d4ce1fabf7947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:37:43Z,use_quota=True,user_id='8ecc2cf53c874b5aa79f95897132a872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7dcad756-11f0-48df-ac79-55cc63413055),volume_type_id=7dcad756-11f0-48df-ac79-55cc63413055)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Creating volume 1c83c436-52f6-452b-b2d6-95b7b82e08f4 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:37:45 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:37:45 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=46, name=volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823f00a8-13da-4047-8a2c-3f2e485366ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b795d94-350c-42ff-83a9-56ba603821e5', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d309b79c-0cc1-48f4-993e-e487db41b367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4 1073741824" returned: 0 in 0.589s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:37:45 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume volume-5b795d94-350c-42ff-83a9-56ba603821e5 (5b795d94-350c-42ff-83a9-56ba603821e5): created successfully Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d309b79c-0cc1-48f4-993e-e487db41b367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Flow 'volume_create_manager' (9c655e05-6e9f-4393-bc34-3c6dc6ef797c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:37:46 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Flow 'volume_create_manager' (4a73de47-b131-43bb-9b8f-bea7d5270770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb58f7ba-e9d2-4db2-8c1a-a87b38161032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4" returned: 0 in 0.454s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] <== create_volume: return (1072ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:37:46 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c9cc9919-a674-4759-838f-3b49a9f2f624 tempest-TestInstancesWithCinderVolumes-1217927981 None] Created volume successfully. Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb58f7ba-e9d2-4db2-8c1a-a87b38161032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-719878389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16eb6db8-e23c-4f71-ab98-9655555338be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4cbdf49fe64a6f808d4ce1fabf7947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:37:45Z,use_quota=True,user_id='8ecc2cf53c874b5aa79f95897132a872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af33b45c-24bd-4861-85a9-3cab29cfd40e),volume_type_id=af33b45c-24bd-4861-85a9-3cab29cfd40e)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f23fd1b-a1a4-4c8c-9192-01cd9b50fe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f23fd1b-a1a4-4c8c-9192-01cd9b50fe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d1f568-1455-483a-82e0-17e404bff670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c9b548-1dda-41da-aeb3-812665e46fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e78cc8-cb9d-4758-9f7f-81cfe2d73cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:46 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4 (1c83c436-52f6-452b-b2d6-95b7b82e08f4): created successfully Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e78cc8-cb9d-4758-9f7f-81cfe2d73cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Flow 'volume_create_manager' (c11c8db1-de94-4f81-8b53-547731cf1243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d1f568-1455-483a-82e0-17e404bff670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '16eb6db8-e23c-4f71-ab98-9655555338be', 'volume_name': 'volume-16eb6db8-e23c-4f71-ab98-9655555338be', 'volume_size': 1, 'image_id': 'a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--126835972', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e4cbdf49fe64a6f808d4ce1fabf7947', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0', 'created_at': datetime.datetime(2025, 9, 17, 5, 37, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 37, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0/file', 'properties': {}}, 'image_service': }' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdaa235-60ac-43b5-b621-544d8ab459ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcdaa235-60ac-43b5-b621-544d8ab459ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f222f06-0ac3-422f-ac2c-bf9fa332b942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:37:46 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume 16eb6db8-e23c-4f71-ab98-9655555338be: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-16eb6db8-e23c-4f71-ab98-9655555338be', 'volume_size': 1, 'image_id': 'a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--126835972', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e4cbdf49fe64a6f808d4ce1fabf7947', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0', 'created_at': datetime.datetime(2025, 9, 17, 5, 37, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 37, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0/file', 'properties': {}}, 'image_service': } Sep 17 07:37:46 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Cloning 16eb6db8-e23c-4f71-ab98-9655555338be from image a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0 at location (None, None). {{(pid=83207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}} Sep 17 07:37:46 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e8f0698c-ac9c-49f4-ad85-ba4b92af2351 tempest-TestInstancesWithCinderVolumes-1217927981 None] Created volume successfully. Sep 17 07:37:48 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8z8vwe8ddevstack@QuobyteHD, size 20.69 MB, duration 1.76 sec {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 17 07:37:48 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Image download 20.69 MB at 11.77 MB/s Sep 17 07:37:48 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24c10cb-c7a4-49dd-b9eb-68b936f97d9c]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:37:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8z8vwe8ddevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:37:48 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8z8vwe8ddevstack@QuobyteHD Sep 17 07:37:48 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:50 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8z8vwe8ddevstack@QuobyteHD" returned: 0 in 2.593s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:37:50 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Temporary image a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0 is fetched for user 8ecc2cf53c874b5aa79f95897132a872. {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 17 07:37:51 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df3e86b-94d0-4898-94a4-cf55a3edca52]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:37:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8z8vwe8ddevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:37:51 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8z8vwe8ddevstack@QuobyteHD Sep 17 07:37:51 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:37:54 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Sep 17 07:37:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8z8vwe8ddevstack@QuobyteHD" returned: 0 in 3.062s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:37:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:37:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:37:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-719878389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16eb6db8-e23c-4f71-ab98-9655555338be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4cbdf49fe64a6f808d4ce1fabf7947',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:37:45Z,use_quota=True,user_id='8ecc2cf53c874b5aa79f95897132a872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af33b45c-24bd-4861-85a9-3cab29cfd40e),volume_type_id=af33b45c-24bd-4861-85a9-3cab29cfd40e)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:37:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Creating volume 16eb6db8-e23c-4f71-ab98-9655555338be {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:37:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:37:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:37:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:37:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:37:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.070s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:37:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:37:54 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:37:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:37:55 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=47, name=volume-16eb6db8-e23c-4f71-ab98-9655555338be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:37:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be 1073741824" returned: 0 in 0.727s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:37:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:37:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be" returned: 0 in 0.127s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:37:55 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] <== create_volume: return (999ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:37:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:37:56 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Attempting download of a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0 ((None, None)) to volume 16eb6db8-e23c-4f71-ab98-9655555338be. {{(pid=83207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 17 07:37:56 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f6ffa1-a4fd-4623-8606-dee13f72db79]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:37:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8wl4yu7l {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:37:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8wl4yu7l" returned: 0 in 0.476s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:37:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8wl4yu7l {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:37:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8wl4yu7l" returned: 1 in 0.615s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:37:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8wl4yu7l' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:37:57 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fe454f-670d-4e62-ad8a-ee656d6f3868]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:37:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8z8vwe8ddevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:37:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8z8vwe8ddevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:37:58 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0 was qcow2, converting to raw {{(pid=83207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 17 07:37:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8z8vwe8ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:37:58 devstack quobyte-client[83219]: System call of process 91170 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:37:58 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=47, name=volume-16eb6db8-e23c-4f71-ab98-9655555338be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:37:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8z8vwe8ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be" returned: 0 in 1.271s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:37:59 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0_8z8vwe8ddevstack@QuobyteHD, size 112.00 MB, duration 1.30 sec, destination /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be {{(pid=83207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 07:37:59 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Converted 112.00 MB image at 85.87 MB/s Sep 17 07:37:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:37:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be 1G" returned: 0 in 0.134s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:37:59 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5a9bf0-b8a3-499d-8d79-965ce8993a03]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:37:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:38:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be" returned: 0 in 0.409s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:38:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:38:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be" returned: 1 in 0.392s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:38:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:38:00 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Downloaded image a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0 ((None, None)) to volume 16eb6db8-e23c-4f71-ab98-9655555338be successfully. {{(pid=83207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 17 07:38:00 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Temporary image a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0 for user 8ecc2cf53c874b5aa79f95897132a872 is deleted. {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 17 07:38:00 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Marking volume 16eb6db8-e23c-4f71-ab98-9655555338be as bootable. {{(pid=83207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 17 07:38:00 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Copying metadata from image a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0 to 16eb6db8-e23c-4f71-ab98-9655555338be. {{(pid=83207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 07:38:00 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Creating volume glance metadata for volume 16eb6db8-e23c-4f71-ab98-9655555338be backed by image a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0 with: {'image_id': 'a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0', 'image_name': 'tempest-scenario-img--126835972', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 07:38:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f222f06-0ac3-422f-ac2c-bf9fa332b942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16eb6db8-e23c-4f71-ab98-9655555338be', 'volume_size': 1, 'image_id': 'a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--126835972', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3e4cbdf49fe64a6f808d4ce1fabf7947', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0', 'created_at': datetime.datetime(2025, 9, 17, 5, 37, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 37, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2a57d89-ca9f-41e4-a7de-5c890bbc6ca0/file', 'properties': {}}, 'image_service': }' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:38:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f64e15a-63e2-423f-974c-f7c573c42c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:38:01 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume volume-16eb6db8-e23c-4f71-ab98-9655555338be (16eb6db8-e23c-4f71-ab98-9655555338be): created successfully Sep 17 07:38:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f64e15a-63e2-423f-974c-f7c573c42c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:38:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Flow 'volume_create_manager' (4a73de47-b131-43bb-9b8f-bea7d5270770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:38:01 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-f8efea38-ef2a-4a8a-8d57-7853e920be18 tempest-TestInstancesWithCinderVolumes-1217927981 None] Created volume successfully. Sep 17 07:38:01 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-2b21c39d-b00f-4bb3-9eac-09b3f420face req-1759abee-4c9c-43f2-83d6-37cdce01fb35 tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:38:01 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-2b21c39d-b00f-4bb3-9eac-09b3f420face req-1759abee-4c9c-43f2-83d6-37cdce01fb35 tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:38:01 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-2b21c39d-b00f-4bb3-9eac-09b3f420face req-1759abee-4c9c-43f2-83d6-37cdce01fb35 tempest-AttachVolumeTestJSON-36775929 None] Terminate volume connection completed successfully. Sep 17 07:38:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-2b21c39d-b00f-4bb3-9eac-09b3f420face req-1759abee-4c9c-43f2-83d6-37cdce01fb35 tempest-AttachVolumeTestJSON-36775929 None] Deleting attachment db8bef79-ff06-470f-9a11-e3f4ad9c8421. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:38:11 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=8,cinder:SELECT=8,cinder:DELETE=3,cinder:INSERT=5 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:38:11 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:INSERT=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:38:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-fea442cb-1f45-45ec-9e62-87ebec04246b req-afea65a3-dc3d-4e65-a3cc-538db6a7c460 tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:38:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-fea442cb-1f45-45ec-9e62-87ebec04246b req-afea65a3-dc3d-4e65-a3cc-538db6a7c460 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:38:12 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[51665a01-f464-4248-ba47-a49fdf4447f6]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:38:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-fea442cb-1f45-45ec-9e62-87ebec04246b req-afea65a3-dc3d-4e65-a3cc-538db6a7c460 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:38:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-fea442cb-1f45-45ec-9e62-87ebec04246b req-afea65a3-dc3d-4e65-a3cc-538db6a7c460 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be" returned: 0 in 0.663s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:38:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-fea442cb-1f45-45ec-9e62-87ebec04246b req-afea65a3-dc3d-4e65-a3cc-538db6a7c460 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:38:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-fea442cb-1f45-45ec-9e62-87ebec04246b req-afea65a3-dc3d-4e65-a3cc-538db6a7c460 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be" returned: 1 in 0.833s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:38:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-fea442cb-1f45-45ec-9e62-87ebec04246b req-afea65a3-dc3d-4e65-a3cc-538db6a7c460 tempest-TestInstancesWithCinderVolumes-1217927981 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:38:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-fea442cb-1f45-45ec-9e62-87ebec04246b req-afea65a3-dc3d-4e65-a3cc-538db6a7c460 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.706s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:38:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-fea442cb-1f45-45ec-9e62-87ebec04246b req-afea65a3-dc3d-4e65-a3cc-538db6a7c460 tempest-TestInstancesWithCinderVolumes-1217927981 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-16eb6db8-e23c-4f71-ab98-9655555338be', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '885052e3-2d9e-4fa9-813c-9d2e32e7246d', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:38:14 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-fea442cb-1f45-45ec-9e62-87ebec04246b req-afea65a3-dc3d-4e65-a3cc-538db6a7c460 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:38:14 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-fea442cb-1f45-45ec-9e62-87ebec04246b req-afea65a3-dc3d-4e65-a3cc-538db6a7c460 tempest-TestInstancesWithCinderVolumes-1217927981 None] attachment_update completed successfully. Sep 17 07:38:16 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-f0843838-b406-4b1b-b289-be8937d43316 req-c4923abb-54a9-49f2-840c-d01099269a9a tempest-AttachVolumeShelveTestJSON-766742006 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:38:16 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-f0843838-b406-4b1b-b289-be8937d43316 req-c4923abb-54a9-49f2-840c-d01099269a9a tempest-AttachVolumeShelveTestJSON-766742006 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:38:16 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-f0843838-b406-4b1b-b289-be8937d43316 req-c4923abb-54a9-49f2-840c-d01099269a9a tempest-AttachVolumeShelveTestJSON-766742006 None] Terminate volume connection completed successfully. Sep 17 07:38:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-f0843838-b406-4b1b-b289-be8937d43316 req-c4923abb-54a9-49f2-840c-d01099269a9a tempest-AttachVolumeShelveTestJSON-766742006 None] Deleting attachment 666b1ee6-a62e-408d-9434-19cd1ae196e5. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:38:26 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:38:26 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=7 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:38:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:38:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:38:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:38:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:38:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:38:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:38:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:38:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.396s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:38:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:39:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:39:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:39:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:39:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:39:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:39:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:39:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:39:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.097s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:39:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:40:06 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:40:06 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:40:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-9f458c6b-0272-4764-a86a-904ff96e629d req-0a223ff2-0a83-48d2-971f-3c402847435d tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:40:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-9f458c6b-0272-4764-a86a-904ff96e629d req-0a223ff2-0a83-48d2-971f-3c402847435d tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:40:07 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcfa7a2-fc1e-40b8-a5be-1f3884dc43f6]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:40:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-9f458c6b-0272-4764-a86a-904ff96e629d req-0a223ff2-0a83-48d2-971f-3c402847435d tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b795d94-350c-42ff-83a9-56ba603821e5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:40:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-9f458c6b-0272-4764-a86a-904ff96e629d req-0a223ff2-0a83-48d2-971f-3c402847435d tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b795d94-350c-42ff-83a9-56ba603821e5" returned: 0 in 0.660s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:40:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-9f458c6b-0272-4764-a86a-904ff96e629d req-0a223ff2-0a83-48d2-971f-3c402847435d tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.736s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:40:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-9f458c6b-0272-4764-a86a-904ff96e629d req-0a223ff2-0a83-48d2-971f-3c402847435d tempest-TestInstancesWithCinderVolumes-1217927981 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-5b795d94-350c-42ff-83a9-56ba603821e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e527eaf1-1f23-4a4d-bfd0-a90f869af01c', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:40:08 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-9f458c6b-0272-4764-a86a-904ff96e629d req-0a223ff2-0a83-48d2-971f-3c402847435d tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:40:08 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-9f458c6b-0272-4764-a86a-904ff96e629d req-0a223ff2-0a83-48d2-971f-3c402847435d tempest-TestInstancesWithCinderVolumes-1217927981 None] attachment_update completed successfully. Sep 17 07:40:18 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:40:18 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:40:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-6f7dcaf1-87f4-4e60-b194-09abf60dd5a3 req-c1a91c05-2ff5-4210-b521-241cdb2c1181 tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:40:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-6f7dcaf1-87f4-4e60-b194-09abf60dd5a3 req-c1a91c05-2ff5-4210-b521-241cdb2c1181 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:40:23 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[218791bc-85f0-47b7-afdc-7273ba2f0209]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:40:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-6f7dcaf1-87f4-4e60-b194-09abf60dd5a3 req-c1a91c05-2ff5-4210-b521-241cdb2c1181 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:40:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-6f7dcaf1-87f4-4e60-b194-09abf60dd5a3 req-c1a91c05-2ff5-4210-b521-241cdb2c1181 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4" returned: 0 in 0.937s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:40:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-6f7dcaf1-87f4-4e60-b194-09abf60dd5a3 req-c1a91c05-2ff5-4210-b521-241cdb2c1181 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.101s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:40:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-6f7dcaf1-87f4-4e60-b194-09abf60dd5a3 req-c1a91c05-2ff5-4210-b521-241cdb2c1181 tempest-TestInstancesWithCinderVolumes-1217927981 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'efe2b75d-563a-4b8a-89d0-ea0e1b5f1ec6', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:40:24 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-6f7dcaf1-87f4-4e60-b194-09abf60dd5a3 req-c1a91c05-2ff5-4210-b521-241cdb2c1181 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:40:25 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-6f7dcaf1-87f4-4e60-b194-09abf60dd5a3 req-c1a91c05-2ff5-4210-b521-241cdb2c1181 tempest-TestInstancesWithCinderVolumes-1217927981 None] attachment_update completed successfully. Sep 17 07:40:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:40:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:40:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:40:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:40:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:40:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:40:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:40:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.364s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:40:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:40:33 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:40:33 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:40:33 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Flow 'volume_create_manager' (2095af8a-ba4a-43ad-8d11-94b3a01eb800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:40:33 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18685c3f-964e-4bbb-9ff2-3c3180410094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:40:33 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18685c3f-964e-4bbb-9ff2-3c3180410094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-15638571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d850109-b7a0-4917-abef-4dd48873672d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d0945f219d45c8bb41b97ae21ee650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:40:32Z,use_quota=True,user_id='9a203994d5604eb59e3d8e5324626746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:40:33 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bafa3a-1900-4e8f-8bff-8e7308f5bf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:40:33 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50bafa3a-1900-4e8f-8bff-8e7308f5bf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:40:33 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de700cfa-cd1d-4105-9454-b83147c9a883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:40:33 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de700cfa-cd1d-4105-9454-b83147c9a883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d850109-b7a0-4917-abef-4dd48873672d', 'volume_name': 'volume-6d850109-b7a0-4917-abef-4dd48873672d', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095523e5-638c-430d-9ea4-3cb9f83bd6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095523e5-638c-430d-9ea4-3cb9f83bd6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554425ff-90b2-44a9-ada0-5c30235e7c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:40:34 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Volume 6d850109-b7a0-4917-abef-4dd48873672d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d850109-b7a0-4917-abef-4dd48873672d', 'volume_size': 1} Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-15638571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d850109-b7a0-4917-abef-4dd48873672d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d0945f219d45c8bb41b97ae21ee650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:40:32Z,use_quota=True,user_id='9a203994d5604eb59e3d8e5324626746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Creating volume 6d850109-b7a0-4917-abef-4dd48873672d {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:40:34 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6d850109-b7a0-4917-abef-4dd48873672d 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:40:34 devstack quobyte-client[83219]: System call of process 92542 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:40:34 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=48, name=volume-6d850109-b7a0-4917-abef-4dd48873672d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6d850109-b7a0-4917-abef-4dd48873672d 1073741824" returned: 0 in 0.759s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:40:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6d850109-b7a0-4917-abef-4dd48873672d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:40:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6d850109-b7a0-4917-abef-4dd48873672d" returned: 0 in 0.172s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:40:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] <== create_volume: return (1188ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:40:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:40:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554425ff-90b2-44a9-ada0-5c30235e7c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d850109-b7a0-4917-abef-4dd48873672d', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:40:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7572a7-3808-485c-a1d0-eea5b7639041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:40:36 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Volume volume-6d850109-b7a0-4917-abef-4dd48873672d (6d850109-b7a0-4917-abef-4dd48873672d): created successfully Sep 17 07:40:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7572a7-3808-485c-a1d0-eea5b7639041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:40:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Flow 'volume_create_manager' (2095af8a-ba4a-43ad-8d11-94b3a01eb800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:40:36 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-f4132b28-56e3-4f30-b80c-cf0a23548745 tempest-AttachVolumeShelveTestJSON-766742006 None] Created volume successfully. Sep 17 07:40:46 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:40:46 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:41:03 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-fcba8f77-4682-41ae-b5e9-9610d1ed4ef4 req-4867853f-ba7d-4fd1-a29d-97124b00d9b6 tempest-AttachVolumeShelveTestJSON-766742006 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:41:03 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-fcba8f77-4682-41ae-b5e9-9610d1ed4ef4 req-4867853f-ba7d-4fd1-a29d-97124b00d9b6 tempest-AttachVolumeShelveTestJSON-766742006 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:41:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-fcba8f77-4682-41ae-b5e9-9610d1ed4ef4 req-4867853f-ba7d-4fd1-a29d-97124b00d9b6 tempest-AttachVolumeShelveTestJSON-766742006 None] No connector for attachment eb985af7-56b3-49f8-aa13-aa1262002261; skipping storage backend terminate_connection call. {{(pid=83207) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}} Sep 17 07:41:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-fcba8f77-4682-41ae-b5e9-9610d1ed4ef4 req-4867853f-ba7d-4fd1-a29d-97124b00d9b6 tempest-AttachVolumeShelveTestJSON-766742006 None] Deleting attachment eb985af7-56b3-49f8-aa13-aa1262002261. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:41:08 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-560d615a-683b-4afb-8494-abc1e10d4822 req-a9042cfd-1af7-4386-bf7c-c238a56aed73 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:41:08 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-560d615a-683b-4afb-8494-abc1e10d4822 req-a9042cfd-1af7-4386-bf7c-c238a56aed73 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:41:08 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-560d615a-683b-4afb-8494-abc1e10d4822 req-a9042cfd-1af7-4386-bf7c-c238a56aed73 tempest-TestInstancesWithCinderVolumes-1217927981 None] Terminate volume connection completed successfully. Sep 17 07:41:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-560d615a-683b-4afb-8494-abc1e10d4822 req-a9042cfd-1af7-4386-bf7c-c238a56aed73 tempest-TestInstancesWithCinderVolumes-1217927981 None] Deleting attachment e527eaf1-1f23-4a4d-bfd0-a90f869af01c. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:41:10 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "cinder-5b795d94-350c-42ff-83a9-56ba603821e5-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:41:10 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "cinder-5b795d94-350c-42ff-83a9-56ba603821e5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:41:11 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:41:11 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "cinder-quobyte-5b795d94-350c-42ff-83a9-56ba603821e5" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:41:11 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "cinder-quobyte-5b795d94-350c-42ff-83a9-56ba603821e5" acquired by "delete_volume" :: waited 0.051s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:41:11 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a500190b-bc3d-438f-87cb-719ddc89fe61]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:41:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b795d94-350c-42ff-83a9-56ba603821e5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:41:12 devstack quobyte-client[83219]: System call of process 92776 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:41:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b795d94-350c-42ff-83a9-56ba603821e5" returned: 0 in 1.140s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:41:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b795d94-350c-42ff-83a9-56ba603821e5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:41:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5b795d94-350c-42ff-83a9-56ba603821e5" returned: 0 in 0.139s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:41:12 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "cinder-quobyte-5b795d94-350c-42ff-83a9-56ba603821e5" released by "delete_volume" :: held 1.568s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:41:13 devstack cinder-volume[83207]: WARNING cinder.quota [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1252037411-1692265364 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1252037411-1692265364, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:41:13 devstack cinder-volume[83207]: WARNING cinder.quota [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1252037411-1692265364 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1252037411-1692265364, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:41:13 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Created reservations ['05cd582d-88c7-4a60-9d2d-5f9d7ed9e55a', '07a1ed1d-d122-4200-a325-be9f3a01bce4', '7f6f543b-154d-4b16-beaf-57be7d87d038', '987a37da-121e-41e5-8945-78eeb2c15045'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:41:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:41:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:41:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:41:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:41:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:41:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:41:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.274s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:41:14 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:41:14 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Deleted volume successfully. Sep 17 07:41:14 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f09d9d93-62aa-4e10-89d6-1a725c2540ee tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "cinder-5b795d94-350c-42ff-83a9-56ba603821e5-delete_volume" released by "delete_volume" :: held 4.049s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:41:23 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:INSERT=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:41:24 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:41:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:41:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:41:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:41:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:41:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:41:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:41:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:41:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.116s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:41:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:41:43 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-47bca640-e2af-4358-a75b-65016f9b68ba req-94868316-bf6e-46f6-a155-9e94003d97a7 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:41:43 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-47bca640-e2af-4358-a75b-65016f9b68ba req-94868316-bf6e-46f6-a155-9e94003d97a7 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:41:43 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-47bca640-e2af-4358-a75b-65016f9b68ba req-94868316-bf6e-46f6-a155-9e94003d97a7 tempest-TestInstancesWithCinderVolumes-1217927981 None] Terminate volume connection completed successfully. Sep 17 07:41:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-47bca640-e2af-4358-a75b-65016f9b68ba req-94868316-bf6e-46f6-a155-9e94003d97a7 tempest-TestInstancesWithCinderVolumes-1217927981 None] Deleting attachment efe2b75d-563a-4b8a-89d0-ea0e1b5f1ec6. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:41:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "cinder-1c83c436-52f6-452b-b2d6-95b7b82e08f4-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:41:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "cinder-1c83c436-52f6-452b-b2d6-95b7b82e08f4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:41:45 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:41:45 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "cinder-quobyte-1c83c436-52f6-452b-b2d6-95b7b82e08f4" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:41:45 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "cinder-quobyte-1c83c436-52f6-452b-b2d6-95b7b82e08f4" acquired by "delete_volume" :: waited 0.038s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:41:45 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf9b419-2c7a-4dd9-a831-c0470a325c54]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:41:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:41:46 devstack quobyte-client[83219]: System call of process 92949 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:41:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4" returned: 0 in 0.865s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:41:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:41:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c83c436-52f6-452b-b2d6-95b7b82e08f4" returned: 0 in 0.152s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:41:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "cinder-quobyte-1c83c436-52f6-452b-b2d6-95b7b82e08f4" released by "delete_volume" :: held 1.398s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:41:47 devstack cinder-volume[83207]: WARNING cinder.quota [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1024467259-622802634 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1024467259-622802634, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:41:47 devstack cinder-volume[83207]: WARNING cinder.quota [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1024467259-622802634 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1024467259-622802634, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:41:47 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Created reservations ['ad9ab340-586d-4c6e-9125-a8e4229bc599', 'a721843e-bd11-4056-bec8-8ca375134fb1', '12b5c637-978b-47a1-a349-67550f495709', '68d7d455-439f-4948-a744-b2aee957a05f'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:41:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:41:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:41:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:41:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:41:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:41:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:41:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.173s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:41:47 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:41:48 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Deleted volume successfully. Sep 17 07:41:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ab214121-9402-4e5d-a59d-021d76943d14 tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "cinder-1c83c436-52f6-452b-b2d6-95b7b82e08f4-delete_volume" released by "delete_volume" :: held 3.875s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:41:54 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Flow 'volume_create_manager' (1610c38f-c695-4f7a-b996-e6d1756fed3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e246fd44-6f91-426b-91aa-36655659575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e246fd44-6f91-426b-91aa-36655659575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1994868655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2b1216-5deb-49f7-9dae-97b6ccbfab4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f01088e632e413e86d9b59e10245140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:41:54Z,use_quota=True,user_id='6133dc4485ac417184098fafc84af9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b670c94c-3f39-4f0f-9caa-e6a515822389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b670c94c-3f39-4f0f-9caa-e6a515822389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414d1748-0c18-4eb7-93ac-4e7f6a420585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414d1748-0c18-4eb7-93ac-4e7f6a420585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d2b1216-5deb-49f7-9dae-97b6ccbfab4c', 'volume_name': 'volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427556bb-858f-46f0-b3d1-c7bfb1d5bfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427556bb-858f-46f0-b3d1-c7bfb1d5bfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1e598f-2265-488b-b3ac-ee350dbd78ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:41:54 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Volume 3d2b1216-5deb-49f7-9dae-97b6ccbfab4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c', 'volume_size': 1} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1994868655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2b1216-5deb-49f7-9dae-97b6ccbfab4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f01088e632e413e86d9b59e10245140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:41:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:41:54Z,use_quota=True,user_id='6133dc4485ac417184098fafc84af9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Creating volume 3d2b1216-5deb-49f7-9dae-97b6ccbfab4c {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:41:54 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:41:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:41:55 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=49, name=volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:41:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c 1073741824" returned: 0 in 0.613s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:41:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:41:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c" returned: 0 in 0.284s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:41:55 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] <== create_volume: return (1029ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:41:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:41:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b1e598f-2265-488b-b3ac-ee350dbd78ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:41:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf55f1d-3104-4b20-946e-4aadebd05e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:41:56 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Volume volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c (3d2b1216-5deb-49f7-9dae-97b6ccbfab4c): created successfully Sep 17 07:41:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cf55f1d-3104-4b20-946e-4aadebd05e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:41:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Flow 'volume_create_manager' (1610c38f-c695-4f7a-b996-e6d1756fed3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:41:56 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-66bb7fac-2e8b-477c-8e62-325e283951d0 tempest-AttachVolumeTestJSON-36775929 None] Created volume successfully. Sep 17 07:41:57 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-bb9f1a10-09af-473b-9215-0b09d53c539c req-1fea6c24-a406-484a-a409-a426b698ec2b tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:41:57 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-bb9f1a10-09af-473b-9215-0b09d53c539c req-1fea6c24-a406-484a-a409-a426b698ec2b tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:41:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-bb9f1a10-09af-473b-9215-0b09d53c539c req-1fea6c24-a406-484a-a409-a426b698ec2b tempest-TestInstancesWithCinderVolumes-1217927981 None] Terminate volume connection completed successfully. Sep 17 07:41:57 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-bb9f1a10-09af-473b-9215-0b09d53c539c req-1fea6c24-a406-484a-a409-a426b698ec2b tempest-TestInstancesWithCinderVolumes-1217927981 None] Deleting attachment 885052e3-2d9e-4fa9-813c-9d2e32e7246d. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:42:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-58ec8c2a-56a6-4228-98b4-b1c24a0bfe4b req-5d9505c6-43a4-4230-b32a-3ed8cf9b1815 tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:42:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-58ec8c2a-56a6-4228-98b4-b1c24a0bfe4b req-5d9505c6-43a4-4230-b32a-3ed8cf9b1815 tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:42:03 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f36e1b-b839-4651-85ad-81c0d55955ae]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:42:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-58ec8c2a-56a6-4228-98b4-b1c24a0bfe4b req-5d9505c6-43a4-4230-b32a-3ed8cf9b1815 tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:42:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "cinder-16eb6db8-e23c-4f71-ab98-9655555338be-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:42:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "cinder-16eb6db8-e23c-4f71-ab98-9655555338be-delete_volume" acquired by "delete_volume" :: waited 0.403s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:42:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-58ec8c2a-56a6-4228-98b4-b1c24a0bfe4b req-5d9505c6-43a4-4230-b32a-3ed8cf9b1815 tempest-AttachVolumeTestJSON-36775929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c" returned: 0 in 1.576s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:42:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-58ec8c2a-56a6-4228-98b4-b1c24a0bfe4b req-5d9505c6-43a4-4230-b32a-3ed8cf9b1815 tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.674s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:42:05 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:42:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "cinder-quobyte-16eb6db8-e23c-4f71-ab98-9655555338be" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:42:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "cinder-quobyte-16eb6db8-e23c-4f71-ab98-9655555338be" acquired by "delete_volume" :: waited 0.022s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:42:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-58ec8c2a-56a6-4228-98b4-b1c24a0bfe4b req-5d9505c6-43a4-4230-b32a-3ed8cf9b1815 tempest-AttachVolumeTestJSON-36775929 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60e86c9b-85f7-435e-8e5e-e6995ac59534', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:42:05 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-58ec8c2a-56a6-4228-98b4-b1c24a0bfe4b req-5d9505c6-43a4-4230-b32a-3ed8cf9b1815 tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:42:05 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e50a80a-66e1-455c-b52b-f33ec6571ea2]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:42:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:42:05 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-58ec8c2a-56a6-4228-98b4-b1c24a0bfe4b req-5d9505c6-43a4-4230-b32a-3ed8cf9b1815 tempest-AttachVolumeTestJSON-36775929 None] attachment_update completed successfully. Sep 17 07:42:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be" returned: 0 in 0.776s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:42:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:42:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be" returned: 1 in 0.735s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:42:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:42:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:42:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-16eb6db8-e23c-4f71-ab98-9655555338be" returned: 0 in 0.124s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:42:07 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "cinder-quobyte-16eb6db8-e23c-4f71-ab98-9655555338be" released by "delete_volume" :: held 2.107s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:42:07 devstack cinder-volume[83207]: WARNING cinder.quota [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-367722245-1325209767 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-367722245-1325209767, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:42:07 devstack cinder-volume[83207]: WARNING cinder.quota [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-367722245-1325209767 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-367722245-1325209767, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:42:07 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Created reservations ['bb39469e-885b-4877-8478-c1307bdfb509', 'ac8ccb0d-2509-4833-af85-33f38e039ec5', 'a455abf4-7671-43b2-9247-6cb3650b1377', 'c1ba0584-f7b8-4a72-9666-23be696a513b'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:42:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:42:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:42:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:42:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:42:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:42:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:42:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.114s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:42:07 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:42:08 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Deleted volume successfully. Sep 17 07:42:08 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6ad57055-83eb-4338-8c98-0af71188fefc tempest-TestInstancesWithCinderVolumes-1217927981 None] Lock "cinder-16eb6db8-e23c-4f71-ab98-9655555338be-delete_volume" released by "delete_volume" :: held 3.655s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:42:14 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Flow 'volume_create_manager' (e7d8073c-a7b7-4b4b-a4de-3e065a8c591e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b490c6f3-1dc8-4127-904a-9552190b3cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b490c6f3-1dc8-4127-904a-9552190b3cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-963090057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f01088e632e413e86d9b59e10245140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:42:14Z,use_quota=True,user_id='6133dc4485ac417184098fafc84af9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddce10b9-53a8-44d8-abb6-b67cd4bbe350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddce10b9-53a8-44d8-abb6-b67cd4bbe350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a84c81-47fe-4ee9-8fa6-26916e060f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a84c81-47fe-4ee9-8fa6-26916e060f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28', 'volume_name': 'volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8939bf4-9eda-46f0-bfa7-7e121737aeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8939bf4-9eda-46f0-bfa7-7e121737aeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc75cf3b-665f-4005-8f3f-17479203684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:42:14 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Volume c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28', 'volume_size': 1} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-963090057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f01088e632e413e86d9b59e10245140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:42:14Z,use_quota=True,user_id='6133dc4485ac417184098fafc84af9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Creating volume c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:42:14 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:42:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:42:15 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=50, name=volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:42:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28 1073741824" returned: 0 in 0.531s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:42:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:42:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28" returned: 0 in 0.191s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:42:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] <== create_volume: return (879ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:42:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:42:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc75cf3b-665f-4005-8f3f-17479203684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:42:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b5029e-e197-4533-b8d8-e347d887ba99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:42:16 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Volume volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28 (c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28): created successfully Sep 17 07:42:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b5029e-e197-4533-b8d8-e347d887ba99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:42:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Flow 'volume_create_manager' (e7d8073c-a7b7-4b4b-a4de-3e065a8c591e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:42:16 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-0b05d66f-12dd-4c5a-800d-bbf610b74a5d tempest-AttachVolumeTestJSON-36775929 None] Created volume successfully. Sep 17 07:42:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-d3b23522-0ab3-4ce4-83ba-e673a2fc928d req-a25aea70-de41-4ed9-ab4e-39a258242eaa tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:42:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-d3b23522-0ab3-4ce4-83ba-e673a2fc928d req-a25aea70-de41-4ed9-ab4e-39a258242eaa tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:42:21 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5a57cc-6bb4-4f24-8568-362da3912def]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:42:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-d3b23522-0ab3-4ce4-83ba-e673a2fc928d req-a25aea70-de41-4ed9-ab4e-39a258242eaa tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:42:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-d3b23522-0ab3-4ce4-83ba-e673a2fc928d req-a25aea70-de41-4ed9-ab4e-39a258242eaa tempest-AttachVolumeTestJSON-36775929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28" returned: 0 in 0.558s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:42:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-d3b23522-0ab3-4ce4-83ba-e673a2fc928d req-a25aea70-de41-4ed9-ab4e-39a258242eaa tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.692s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:42:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-d3b23522-0ab3-4ce4-83ba-e673a2fc928d req-a25aea70-de41-4ed9-ab4e-39a258242eaa tempest-AttachVolumeTestJSON-36775929 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e05f9e6e-4b4d-4c06-af26-25214a534acb', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:42:22 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-d3b23522-0ab3-4ce4-83ba-e673a2fc928d req-a25aea70-de41-4ed9-ab4e-39a258242eaa tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:42:22 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-d3b23522-0ab3-4ce4-83ba-e673a2fc928d req-a25aea70-de41-4ed9-ab4e-39a258242eaa tempest-AttachVolumeTestJSON-36775929 None] attachment_update completed successfully. Sep 17 07:42:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:42:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:42:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:42:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:42:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:42:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:42:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:42:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.158s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:42:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:42:32 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=29,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:42:32 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=3 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:42:51 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-994342ca-0f57-4279-ba65-303105c619bb req-b9c8356c-ea20-4a45-afb2-098f97967227 tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:42:51 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-994342ca-0f57-4279-ba65-303105c619bb req-b9c8356c-ea20-4a45-afb2-098f97967227 tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:42:51 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-994342ca-0f57-4279-ba65-303105c619bb req-b9c8356c-ea20-4a45-afb2-098f97967227 tempest-AttachVolumeTestJSON-36775929 None] Terminate volume connection completed successfully. Sep 17 07:42:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-994342ca-0f57-4279-ba65-303105c619bb req-b9c8356c-ea20-4a45-afb2-098f97967227 tempest-AttachVolumeTestJSON-36775929 None] Deleting attachment 60e86c9b-85f7-435e-8e5e-e6995ac59534. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:43:01 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:43:01 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:43:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Acquiring lock "cinder-6d850109-b7a0-4917-abef-4dd48873672d-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "cinder-6d850109-b7a0-4917-abef-4dd48873672d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:04 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:43:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Acquiring lock "cinder-quobyte-6d850109-b7a0-4917-abef-4dd48873672d" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "cinder-quobyte-6d850109-b7a0-4917-abef-4dd48873672d" acquired by "delete_volume" :: waited 0.017s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:04 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0d8397-7619-4c19-bfc2-74412e2c6799]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:43:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6d850109-b7a0-4917-abef-4dd48873672d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6d850109-b7a0-4917-abef-4dd48873672d" returned: 0 in 1.302s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6d850109-b7a0-4917-abef-4dd48873672d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6d850109-b7a0-4917-abef-4dd48873672d" returned: 0 in 0.160s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:06 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "cinder-quobyte-6d850109-b7a0-4917-abef-4dd48873672d" released by "delete_volume" :: held 1.777s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:06 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Created reservations ['8feabfd7-5a2a-4ed0-88cf-58731cb3f2d8', '050f9ae9-7407-40c8-b8b9-e8995ceb876f', 'bfc528c3-f9e7-498d-888a-6bb58afc84b2', '0f96588c-a993-40f5-9fe2-b800d84e2298'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:43:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:43:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:43:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:43:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:43:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:43:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:07 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:43:07 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:43:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Flow 'volume_create_manager' (d53108b4-18f2-4ea5-9642-f78a1977a013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:43:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6109e464-0b2a-4212-9cdc-5ec6f3dd52e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:43:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.543s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:07 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6109e464-0b2a-4212-9cdc-5ec6f3dd52e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1347955751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6fbbd0d-7ffd-4456-9410-e080c9daaf83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7496462ed240a48012aba6282605c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:07Z,use_quota=True,user_id='dc7f712a685d4909bb2546a496d19e29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ce799e-724b-4daf-8fc8-8099b386d6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ce799e-724b-4daf-8fc8-8099b386d6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16168023-511b-4d9b-9260-8973dedc570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16168023-511b-4d9b-9260-8973dedc570d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6fbbd0d-7ffd-4456-9410-e080c9daaf83', 'volume_name': 'volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1bd7e34-04f5-4bbc-9900-81f7f8057b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1bd7e34-04f5-4bbc-9900-81f7f8057b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36531047-2f1a-4084-be67-b7e3fa39e889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:43:08 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Volume d6fbbd0d-7ffd-4456-9410-e080c9daaf83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83', 'volume_size': 1} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1347955751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6fbbd0d-7ffd-4456-9410-e080c9daaf83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7496462ed240a48012aba6282605c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:07Z,use_quota=True,user_id='dc7f712a685d4909bb2546a496d19e29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Creating volume d6fbbd0d-7ffd-4456-9410-e080c9daaf83 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:43:08 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:08 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Deleted volume successfully. Sep 17 07:43:08 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=51, name=volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e1a1dc32-dc50-4ae2-b6d2-8eacf706c7f8 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "cinder-6d850109-b7a0-4917-abef-4dd48873672d-delete_volume" released by "delete_volume" :: held 4.019s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Acquiring lock "cinder-91d457f6-21f2-4293-a723-9beef760caa4-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 1073741824" returned: 0 in 0.617s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "cinder-91d457f6-21f2-4293-a723-9beef760caa4-delete_volume" acquired by "delete_volume" :: waited 0.200s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83" returned: 0 in 0.288s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] <== create_volume: return (971ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:43:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:43:09 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:43:09 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Acquiring lock "cinder-quobyte-91d457f6-21f2-4293-a723-9beef760caa4" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36531047-2f1a-4084-be67-b7e3fa39e889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:43:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d35517-fae0-44ce-a90f-2ebc7083ea23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:43:09 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "cinder-quobyte-91d457f6-21f2-4293-a723-9beef760caa4" acquired by "delete_volume" :: waited 0.053s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:09 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[32df37ef-542f-4077-a3b0-f6063fb06e5c]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:43:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91d457f6-21f2-4293-a723-9beef760caa4 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:09 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Volume volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 (d6fbbd0d-7ffd-4456-9410-e080c9daaf83): created successfully Sep 17 07:43:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d35517-fae0-44ce-a90f-2ebc7083ea23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:43:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Flow 'volume_create_manager' (d53108b4-18f2-4ea5-9642-f78a1977a013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:43:09 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-73d10745-082e-4340-8fdd-02df1f1ed504 tempest-SnapshotDependencyTests-674725753 None] Created volume successfully. Sep 17 07:43:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91d457f6-21f2-4293-a723-9beef760caa4" returned: 0 in 0.566s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91d457f6-21f2-4293-a723-9beef760caa4 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-91d457f6-21f2-4293-a723-9beef760caa4" returned: 0 in 0.085s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:10 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "cinder-quobyte-91d457f6-21f2-4293-a723-9beef760caa4" released by "delete_volume" :: held 0.806s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:10 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Created reservations ['fefeac0d-2db0-4f42-a487-32541ef03d67', '53758123-d619-488e-8564-08311973ff82', 'a4c0d20e-f845-4c31-91ce-d2deca5f09e0', '1058204a-891f-44b8-9a3a-1daf793a191f'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:43:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:43:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:43:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:43:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:43:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:43:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.110s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:10 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:43:10 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Deleted volume successfully. Sep 17 07:43:10 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2f7061c7-4191-4fad-bebd-f34d75b47ff1 tempest-AttachVolumeShelveTestJSON-766742006 None] Lock "cinder-91d457f6-21f2-4293-a723-9beef760caa4-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:11 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:43:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:43:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:43:11 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] Creating offline snapshot bd23acf8-04ea-4564-9e92-c5bbc1504165 of volume d6fbbd0d-7ffd-4456-9410-e080c9daaf83 {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:43:11 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04cf707-1cfd-490c-974c-6da45cc891f7]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:43:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83" returned: 0 in 0.487s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:12 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=52, name=volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:43:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165 1G" returned: 0 in 0.293s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] CMD "qemu-img rebase -u -b volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165" returned: 0 in 0.150s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:43:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165" returned: 0 in 0.140s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:43:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165" returned: 0 in 0.105s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.info" returned: 0 in 0.118s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:43:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.info" returned: 0 in 0.101s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:43:13 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-cd0e3ca6-7082-42d1-9c89-3486293b7b7d tempest-SnapshotDependencyTests-674725753 None] Create snapshot completed successfully Sep 17 07:43:15 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Flow 'volume_create_manager' (b53c9360-f28f-49d3-a8ff-2598ffdf366c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e919d2-fde9-4f25-94c7-189f8148a323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e919d2-fde9-4f25-94c7-189f8148a323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7496462ed240a48012aba6282605c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bd23acf8-04ea-4564-9e92-c5bbc1504165,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:43:15Z,use_quota=True,user_id='dc7f712a685d4909bb2546a496d19e29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f42a8c-fdbf-4246-a813-3dd50adb5c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f42a8c-fdbf-4246-a813-3dd50adb5c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c759e5c4-293f-4781-a37b-48f2f2da9453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c759e5c4-293f-4781-a37b-48f2f2da9453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e', 'volume_name': 'volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e', 'volume_size': 1, 'snapshot_id': 'bd23acf8-04ea-4564-9e92-c5bbc1504165'}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd655146-1a8a-47b9-9f79-bc35c5541bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd655146-1a8a-47b9-9f79-bc35c5541bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e2dd5d-8fac-40b8-b896-07ac949f1312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:43:15 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Volume ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e', 'volume_size': 1, 'snapshot_id': 'bd23acf8-04ea-4564-9e92-c5bbc1504165'} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "cinder-quobyte-bd23acf8-04ea-4564-9e92-c5bbc1504165-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e" by "_create_volume_from_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-quobyte-bd23acf8-04ea-4564-9e92-c5bbc1504165-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Creating volume ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e from snapshot bd23acf8-04ea-4564-9e92-c5bbc1504165 {{(pid=83207) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "cinder-quobyte-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e" by "_copy_volume_from_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-quobyte-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] snapshot: bd23acf8-04ea-4564-9e92-c5bbc1504165, volume: ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e, {{(pid=83207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1846b35-abc9-4fde-add8-203e6129d8ab]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:43:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:16 devstack quobyte-client[83219]: System call of process 93693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:43:16 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-68ebf774-74cd-4281-85c8-1b52c49b14a8 req-83c6dc89-fe26-4244-8c8d-1d3fe0a8041f tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:43:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165" returned: 0 in 1.136s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:43:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] will copy from snapshot at /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 {{(pid=83207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 17 07:43:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Creating direct copy from snapshot {{(pid=83207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 17 07:43:17 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[06939373-b2bb-4444-a824-e3134180b8f0]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:43:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:17 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-68ebf774-74cd-4281-85c8-1b52c49b14a8 req-83c6dc89-fe26-4244-8c8d-1d3fe0a8041f tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:43:17 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-68ebf774-74cd-4281-85c8-1b52c49b14a8 req-83c6dc89-fe26-4244-8c8d-1d3fe0a8041f tempest-AttachVolumeTestJSON-36775929 None] Terminate volume connection completed successfully. Sep 17 07:43:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-68ebf774-74cd-4281-85c8-1b52c49b14a8 req-83c6dc89-fe26-4244-8c8d-1d3fe0a8041f tempest-AttachVolumeTestJSON-36775929 None] Deleting attachment e05f9e6e-4b4d-4c06-af26-25214a534acb. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:43:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83" returned: 0 in 0.742s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:17 devstack cinder-volume[83207]: DEBUG cinder.utils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e not found in is_blk_device check {{(pid=83207) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 17 07:43:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:18 devstack quobyte-client[83219]: System call of process 93703 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:43:18 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=54, name=volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:43:27 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=18,cinder:INSERT=7,cinder:UPDATE=22 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:43:27 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=13,cinder:UPDATE=17,cinder:INSERT=1,cinder:DELETE=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:43:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:43:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:43:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:43:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:43:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:43:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:43:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e" returned: 0 in 10.046s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.539s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:28 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[567275cb-1c2f-45d8-8336-a3788f3155fe]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:43:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:43:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83" returned: 0 in 0.987s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:29 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Image conversion details: src /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83, size 1024.00 MB, duration 10.17 sec, destination /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e {{(pid=83207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 07:43:29 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Converted 1024.00 MB image at 100.67 MB/s Sep 17 07:43:29 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:43:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e" returned: 0 in 0.273s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-quobyte-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e" released by "_copy_volume_from_snapshot" :: held 13.964s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-quobyte-bd23acf8-04ea-4564-9e92-c5bbc1504165-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e" released by "_create_volume_from_snapshot" :: held 14.086s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.135s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:43:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2e2dd5d-8fac-40b8-b896-07ac949f1312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e', 'volume_size': 1, 'snapshot_id': 'bd23acf8-04ea-4564-9e92-c5bbc1504165'}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:43:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1eb965-89ee-4066-aaa6-d29e927e9ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:43:30 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Volume volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e (ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e): created successfully Sep 17 07:43:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1eb965-89ee-4066-aaa6-d29e927e9ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:43:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Flow 'volume_create_manager' (b53c9360-f28f-49d3-a8ff-2598ffdf366c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:43:30 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-768463d8-605a-4ea5-9132-3880a8236090 tempest-SnapshotDependencyTests-674725753 None] Created volume successfully. Sep 17 07:43:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "cinder-bd23acf8-04ea-4564-9e92-c5bbc1504165-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-bd23acf8-04ea-4564-9e92-c5bbc1504165-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:31 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:43:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "cinder-quobyte-d6fbbd0d-7ffd-4456-9410-e080c9daaf83" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-quobyte-d6fbbd0d-7ffd-4456-9410-e080c9daaf83" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "cinder-quobyte-bd23acf8-04ea-4564-9e92-c5bbc1504165" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-quobyte-bd23acf8-04ea-4564-9e92-c5bbc1504165" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Deleting offline snapshot bd23acf8-04ea-4564-9e92-c5bbc1504165 of volume d6fbbd0d-7ffd-4456-9410-e080c9daaf83 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:43:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] snapshot_file for this snap is: volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:43:31 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d43e9d3-5939-4c45-9b21-e8a1464c2ef7]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:43:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165" returned: 0 in 0.504s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:32 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:43:32 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a23eb1-a6fb-4fc0-bb11-f46f152ef72a]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:43:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83" returned: 0 in 0.646s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165" returned: 0 in 0.256s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83.bd23acf8-04ea-4564-9e92-c5bbc1504165" returned: 0 in 0.123s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:33 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-quobyte-bd23acf8-04ea-4564-9e92-c5bbc1504165" released by "_delete_snapshot" :: held 1.850s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:33 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-quobyte-d6fbbd0d-7ffd-4456-9410-e080c9daaf83" released by "delete_snapshot" :: held 1.886s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:34 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Created reservations ['a87ae08e-8b08-44c0-b0a8-e6ba29e0ed8c', 'd45b1461-0c4a-4017-841f-b417e5bc6fd8', '1d8ed551-8b7f-4008-bbf8-42e2b5a0b558', 'a8b8b7e8-fa39-47f1-a05a-91caf7e24a3e'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:43:34 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Delete snapshot completed successfully. Sep 17 07:43:34 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4713c888-0d72-4725-b236-576a8bfebc0d tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-bd23acf8-04ea-4564-9e92-c5bbc1504165-delete_snapshot" released by "delete_snapshot" :: held 2.559s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:35 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "cinder-d6fbbd0d-7ffd-4456-9410-e080c9daaf83-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:35 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-d6fbbd0d-7ffd-4456-9410-e080c9daaf83-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:35 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:43:35 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "cinder-quobyte-d6fbbd0d-7ffd-4456-9410-e080c9daaf83" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:35 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-quobyte-d6fbbd0d-7ffd-4456-9410-e080c9daaf83" acquired by "delete_volume" :: waited 0.061s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:35 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ea3a4c-36e2-4e21-a818-f9d9dcdfe3f0]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:43:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:35 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "cinder-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:35 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Lock "cinder-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:36 devstack quobyte-client[83219]: System call of process 93790 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:43:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83" returned: 0 in 0.783s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d6fbbd0d-7ffd-4456-9410-e080c9daaf83" returned: 0 in 0.385s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:36 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:43:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "cinder-quobyte-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-quobyte-d6fbbd0d-7ffd-4456-9410-e080c9daaf83" released by "delete_volume" :: held 1.429s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Lock "cinder-quobyte-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28" acquired by "delete_volume" :: waited 0.090s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:36 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85bb73e-0dac-4bb7-a553-326a50b47a80]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:43:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:37 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Created reservations ['46dfe0b9-3362-4678-b0f2-a0596bde578f', 'cef589be-ac80-4ef3-bef5-bb0dc5fd13b5', '29f9196a-8c15-4e6b-a23c-9c005f939e5c', '7a7ccdd9-d6d9-48b4-9f96-d04d4659dcbf'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:43:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:43:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:43:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:43:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:43:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:43:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28" returned: 0 in 0.684s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:37 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "cinder-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28" returned: 0 in 0.379s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.554s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:38 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:43:38 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Deleted volume successfully. Sep 17 07:43:38 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Lock "cinder-quobyte-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28" released by "delete_volume" :: held 1.432s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:38 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e-delete_volume" acquired by "delete_volume" :: waited 0.331s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:38 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a3c2adf5-daa6-4d26-b104-c03dbf026876 tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-d6fbbd0d-7ffd-4456-9410-e080c9daaf83-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:38 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:43:38 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "cinder-quobyte-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:38 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-quobyte-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e" acquired by "delete_volume" :: waited 0.021s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:38 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[12966218-9281-42f1-857b-70621ca66e82]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:43:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:38 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Created reservations ['a11e2324-0170-4916-8f68-0b52f999cfa9', '14c10168-2c83-4bc0-9dfe-cdec83037c7b', '46cf6ad3-acdc-40ed-904d-c68042bb6fd1', '002a77d6-269a-444a-bfa2-3a88594f9d2d'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:43:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:43:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:43:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:43:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:43:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:43:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:39 devstack quobyte-client[83219]: System call of process 93805 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:43:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.135s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:39 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:43:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e" returned: 0 in 0.848s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:39 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Deleted volume successfully. Sep 17 07:43:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e" returned: 0 in 0.268s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:39 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-quobyte-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e" released by "delete_volume" :: held 1.232s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:39 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5e0ed232-be2e-4a65-9943-97ed2c22f67f tempest-AttachVolumeTestJSON-36775929 None] Lock "cinder-c0c17fe7-ecaf-4a40-8b2b-33a92ade4b28-delete_volume" released by "delete_volume" :: held 3.844s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:39 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Created reservations ['a0b9db78-7761-47ec-864b-419f2c19de03', '7b99b799-92b5-4137-a940-349dec1e7451', 'b958952d-c99f-45e1-98d5-251b64306834', '5d479461-5eea-49dd-9182-8a50d2b036dc'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:43:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:43:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:43:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:43:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:43:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:43:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.114s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:40 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:43:40 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Deleted volume successfully. Sep 17 07:43:40 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4424e44c-2944-4bff-80fb-f8954c18fca0 tempest-SnapshotDependencyTests-674725753 None] Lock "cinder-ec694b5a-8d5a-4dbe-bc7e-ab9a95d0fb0e-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:40 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "cinder-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:40 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Lock "cinder-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:41 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:43:41 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "cinder-quobyte-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:41 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Lock "cinder-quobyte-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c" acquired by "delete_volume" :: waited 0.011s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:41 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[201ca27c-fa72-4882-89b3-f0b9dadf5320]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:43:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c" returned: 0 in 0.525s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c" returned: 0 in 0.115s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:42 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Lock "cinder-quobyte-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c" released by "delete_volume" :: held 0.918s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:42 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Created reservations ['2b1fea7a-7cf5-4256-a87d-08c81d5a235d', '9d93e271-67e0-48a3-877a-a3ce0036dabf', 'dd41e38f-5050-4576-870d-6f5b2563e232', 'f3a02404-1652-4399-8638-15958b482d11'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:43:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:43:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:43:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:43:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:43:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:43:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.160s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:42 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:43:42 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Deleted volume successfully. Sep 17 07:43:43 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-5e91d287-194e-43a7-ab26-a487cc7ffd7a tempest-AttachVolumeTestJSON-36775929 None] Lock "cinder-3d2b1216-5deb-49f7-9dae-97b6ccbfab4c-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "cinder-45679c1c-1139-4091-8eb3-0eaf461e19ba-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Lock "cinder-45679c1c-1139-4091-8eb3-0eaf461e19ba-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:44 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:43:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "cinder-quobyte-45679c1c-1139-4091-8eb3-0eaf461e19ba" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:43:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Lock "cinder-quobyte-45679c1c-1139-4091-8eb3-0eaf461e19ba" acquired by "delete_volume" :: waited 0.036s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:43:44 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[43430111-0981-4924-8cc2-98f9b7619e8b]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:43:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-45679c1c-1139-4091-8eb3-0eaf461e19ba {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-45679c1c-1139-4091-8eb3-0eaf461e19ba" returned: 0 in 0.769s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-45679c1c-1139-4091-8eb3-0eaf461e19ba {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-45679c1c-1139-4091-8eb3-0eaf461e19ba" returned: 0 in 0.151s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:45 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Lock "cinder-quobyte-45679c1c-1139-4091-8eb3-0eaf461e19ba" released by "delete_volume" :: held 1.166s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:45 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Created reservations ['8282bf7b-58ff-410b-8e4b-4c51daa199ee', 'a5741a2b-afe9-4796-bb28-21ee9c104b61', '65698fcf-4daf-4738-8336-2ade23ca788c', '3cfa737f-2857-485a-a575-f9446a50f7f0'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:43:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:43:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:43:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:43:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:43:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:43:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:43:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.146s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:43:46 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:43:46 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Deleted volume successfully. Sep 17 07:43:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-249203a2-0c10-4dfa-9b74-d1b3a54d52fa tempest-AttachVolumeTestJSON-36775929 None] Lock "cinder-45679c1c-1139-4091-8eb3-0eaf461e19ba-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:43:56 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=42,cinder:DELETE=3,cinder:SELECT=23,cinder:INSERT=14 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:43:56 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=37,cinder:UPDATE=52,cinder:INSERT=10,cinder:DELETE=3 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:44:02 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:44:02 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:44:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Flow 'volume_create_manager' (69c896fe-c084-4a55-925c-4428309e59e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:44:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689c2316-0a24-48e1-80a5-5eff45552100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689c2316-0a24-48e1-80a5-5eff45552100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1196683279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c45031-f844-46cd-abb8-ad4a620ec7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c0e17a191a407d86e0d35bf463e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:03Z,use_quota=True,user_id='a590e5f141fb499484618c58760276b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9860d7d2-2b7a-4621-9941-c699799c5cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9860d7d2-2b7a-4621-9941-c699799c5cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b176144-b884-41e7-b46c-64b5e02c53ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b176144-b884-41e7-b46c-64b5e02c53ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c45031-f844-46cd-abb8-ad4a620ec7c9', 'volume_name': 'volume-03c45031-f844-46cd-abb8-ad4a620ec7c9', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b02f0e-600a-4c0a-aa76-b4ce33c0abe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b02f0e-600a-4c0a-aa76-b4ce33c0abe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a05b50-52da-47c1-8756-6f0f8b4f5444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:03 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Volume 03c45031-f844-46cd-abb8-ad4a620ec7c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c45031-f844-46cd-abb8-ad4a620ec7c9', 'volume_size': 1} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:44:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1196683279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c45031-f844-46cd-abb8-ad4a620ec7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c0e17a191a407d86e0d35bf463e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:03Z,use_quota=True,user_id='a590e5f141fb499484618c58760276b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Creating volume 03c45031-f844-46cd-abb8-ad4a620ec7c9 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:44:03 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03c45031-f844-46cd-abb8-ad4a620ec7c9 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:03 devstack quobyte-client[83219]: System call of process 93836 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:44:03 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=55, name=volume-03c45031-f844-46cd-abb8-ad4a620ec7c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:44:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03c45031-f844-46cd-abb8-ad4a620ec7c9 1073741824" returned: 0 in 0.844s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03c45031-f844-46cd-abb8-ad4a620ec7c9 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03c45031-f844-46cd-abb8-ad4a620ec7c9" returned: 0 in 0.132s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:04 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] <== create_volume: return (1094ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:44:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:44:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a05b50-52da-47c1-8756-6f0f8b4f5444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c45031-f844-46cd-abb8-ad4a620ec7c9', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2371fe-cb4e-47e6-9d22-028638d08e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:04 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Volume volume-03c45031-f844-46cd-abb8-ad4a620ec7c9 (03c45031-f844-46cd-abb8-ad4a620ec7c9): created successfully Sep 17 07:44:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f2371fe-cb4e-47e6-9d22-028638d08e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Flow 'volume_create_manager' (69c896fe-c084-4a55-925c-4428309e59e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:44:04 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-54fbc336-6302-4bec-99f4-13cb62e67abe tempest-VolumeQuotasAdminTestJSON-492989718 None] Created volume successfully. Sep 17 07:44:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Acquiring lock "cinder-03c45031-f844-46cd-abb8-ad4a620ec7c9-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:44:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Lock "cinder-03c45031-f844-46cd-abb8-ad4a620ec7c9-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:44:05 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:44:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Acquiring lock "cinder-quobyte-03c45031-f844-46cd-abb8-ad4a620ec7c9" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:44:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Lock "cinder-quobyte-03c45031-f844-46cd-abb8-ad4a620ec7c9" acquired by "delete_volume" :: waited 0.048s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:44:05 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[632a40c1-39aa-400f-b3ae-a8a8688d9cb0]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:44:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03c45031-f844-46cd-abb8-ad4a620ec7c9 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:06 devstack quobyte-client[83219]: System call of process 93840 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:44:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03c45031-f844-46cd-abb8-ad4a620ec7c9" returned: 0 in 0.592s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03c45031-f844-46cd-abb8-ad4a620ec7c9 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03c45031-f844-46cd-abb8-ad4a620ec7c9" returned: 0 in 0.229s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:06 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Lock "cinder-quobyte-03c45031-f844-46cd-abb8-ad4a620ec7c9" released by "delete_volume" :: held 1.205s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:44:07 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Created reservations ['a3657c6b-2b42-4526-8dc5-1f0f4da5ce25', 'b5a254c7-188d-4742-adc4-ccf14b2f7ef3', '859445c0-156d-42cd-a5c9-9b531dfe4f25', '5e7ec3c4-b451-401d-bfc4-9f369e435f9a'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:44:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:44:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:44:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:44:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:44:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:44:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.119s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:07 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:44:07 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Deleted volume successfully. Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-02d75c8c-6dc2-45b8-bef6-5a161782f23f tempest-VolumeQuotasAdminTestJSON-492989718 None] Lock "cinder-03c45031-f844-46cd-abb8-ad4a620ec7c9-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:44:08 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Flow 'volume_create_manager' (8eaffeff-e7ac-4d80-9186-d61034040ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00093d78-4a4c-4be6-9628-06673de29e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00093d78-4a4c-4be6-9628-06673de29e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-523580621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6488d34-a62f-466b-97e4-b3a715c41c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c0e17a191a407d86e0d35bf463e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:08Z,use_quota=True,user_id='a590e5f141fb499484618c58760276b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e765b1b-8460-42a0-a03c-3e3b40adf2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e765b1b-8460-42a0-a03c-3e3b40adf2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b90271-7b25-4884-af4a-6efd300968a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b90271-7b25-4884-af4a-6efd300968a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6488d34-a62f-466b-97e4-b3a715c41c43', 'volume_name': 'volume-a6488d34-a62f-466b-97e4-b3a715c41c43', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a699f3bc-3ccc-45d3-8135-08f79ad768f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a699f3bc-3ccc-45d3-8135-08f79ad768f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e5c72e-a479-4d9f-9fee-725c88341bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:08 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Volume a6488d34-a62f-466b-97e4-b3a715c41c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6488d34-a62f-466b-97e4-b3a715c41c43', 'volume_size': 1} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-523580621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6488d34-a62f-466b-97e4-b3a715c41c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c0e17a191a407d86e0d35bf463e6b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:08Z,use_quota=True,user_id='a590e5f141fb499484618c58760276b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Creating volume a6488d34-a62f-466b-97e4-b3a715c41c43 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:44:08 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:44:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a6488d34-a62f-466b-97e4-b3a715c41c43 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:09 devstack quobyte-client[83219]: System call of process 93877 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:44:09 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=56, name=volume-a6488d34-a62f-466b-97e4-b3a715c41c43, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:44:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a6488d34-a62f-466b-97e4-b3a715c41c43 1073741824" returned: 0 in 0.409s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a6488d34-a62f-466b-97e4-b3a715c41c43 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a6488d34-a62f-466b-97e4-b3a715c41c43" returned: 0 in 0.145s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] <== create_volume: return (630ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:44:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.643s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:44:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e5c72e-a479-4d9f-9fee-725c88341bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6488d34-a62f-466b-97e4-b3a715c41c43', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c479652c-ff58-45aa-a3ce-d2f1a63c1df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:09 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Volume volume-a6488d34-a62f-466b-97e4-b3a715c41c43 (a6488d34-a62f-466b-97e4-b3a715c41c43): created successfully Sep 17 07:44:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c479652c-ff58-45aa-a3ce-d2f1a63c1df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Flow 'volume_create_manager' (8eaffeff-e7ac-4d80-9186-d61034040ea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:44:09 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-9bfd4427-0a5f-4d7b-9244-5140fb3cef60 tempest-VolumeQuotasAdminTestJSON-492989718 None] Created volume successfully. Sep 17 07:44:11 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-da14cb3f-57b9-47e5-b475-a047c555e53f tempest-VolumeQuotasAdminTestJSON-1371541990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:44:11 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-da14cb3f-57b9-47e5-b475-a047c555e53f tempest-VolumeQuotasAdminTestJSON-1371541990 None] Transfer volume completed successfully. Sep 17 07:44:13 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Acquiring lock "cinder-a6488d34-a62f-466b-97e4-b3a715c41c43-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:44:13 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Lock "cinder-a6488d34-a62f-466b-97e4-b3a715c41c43-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:44:13 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:44:13 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Acquiring lock "cinder-quobyte-a6488d34-a62f-466b-97e4-b3a715c41c43" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:44:13 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Lock "cinder-quobyte-a6488d34-a62f-466b-97e4-b3a715c41c43" acquired by "delete_volume" :: waited 0.021s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:44:13 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2615fe-1f08-40dc-b5d4-dac6c7e70fec]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:44:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a6488d34-a62f-466b-97e4-b3a715c41c43 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a6488d34-a62f-466b-97e4-b3a715c41c43" returned: 0 in 0.537s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a6488d34-a62f-466b-97e4-b3a715c41c43 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a6488d34-a62f-466b-97e4-b3a715c41c43" returned: 0 in 0.156s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:14 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Lock "cinder-quobyte-a6488d34-a62f-466b-97e4-b3a715c41c43" released by "delete_volume" :: held 0.868s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:44:15 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Created reservations ['9455b8cd-65cf-4da9-97f0-baaba10edb65', 'e1fa5cf7-deab-4cd0-901d-16b713e32137', '59dfc55a-4e41-4f43-a296-510a87b89c1e', 'ccfac173-90a8-401a-9869-80862b3147a6'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:44:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:44:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:44:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:44:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:44:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:44:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.135s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:15 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:44:15 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Deleted volume successfully. Sep 17 07:44:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-87fc8488-489a-407c-a587-d5320c8e32dc tempest-VolumeQuotasAdminTestJSON-1942911607 None] Lock "cinder-a6488d34-a62f-466b-97e4-b3a715c41c43-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=14,cinder:UPDATE=27,cinder:INSERT=3 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:44:25 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Flow 'volume_create_manager' (adbe99fc-4bc5-4b3f-88ff-bcb48efa7ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2933bb-4841-405f-9868-43a1256610ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc2933bb-4841-405f-9868-43a1256610ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-928222261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713fe0eeef94435e90b2504a99af9e8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:25Z,use_quota=True,user_id='3b43a4485cca4b038206a4fd1ff8a8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56559250-4d38-4cc1-aa58-99a71703e1ef),volume_type_id=56559250-4d38-4cc1-aa58-99a71703e1ef)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af56804-f274-479a-84c9-ee0480d1d63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af56804-f274-479a-84c9-ee0480d1d63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ddb202-f6d9-4ec5-8ac0-756d4d2315de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ddb202-f6d9-4ec5-8ac0-756d4d2315de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c', 'volume_name': 'volume-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211a161d-d79b-49ab-a938-1e85f8f76fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211a161d-d79b-49ab-a938-1e85f8f76fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7ca3c9-054e-459e-868d-ff70d68b0108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:25 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Volume bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c', 'volume_size': 1} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-928222261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='713fe0eeef94435e90b2504a99af9e8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:44:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:44:25Z,use_quota=True,user_id='3b43a4485cca4b038206a4fd1ff8a8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56559250-4d38-4cc1-aa58-99a71703e1ef),volume_type_id=56559250-4d38-4cc1-aa58-99a71703e1ef)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Creating volume bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:44:25 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:44:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:25 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=57, name=volume-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:44:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c 1073741824" returned: 0 in 0.380s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c" returned: 0 in 0.124s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] <== create_volume: return (573ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:44:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.588s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:44:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a7ca3c9-054e-459e-868d-ff70d68b0108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53cff16-2252-449a-8cbd-1ae7c454b3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:44:26 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Volume volume-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c (bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c): created successfully Sep 17 07:44:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53cff16-2252-449a-8cbd-1ae7c454b3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:44:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Flow 'volume_create_manager' (adbe99fc-4bc5-4b3f-88ff-bcb48efa7ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:44:26 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-dc2dbd40-8092-477a-9f47-19dedcfb84f3 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Created volume successfully. Sep 17 07:44:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:44:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:44:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:44:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:44:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:44:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:44:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.112s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:44:27 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-49f49cde-2e38-408d-829a-fd72481e5315 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:44:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-49f49cde-2e38-408d-829a-fd72481e5315 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:44:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-49f49cde-2e38-408d-829a-fd72481e5315 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:44:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-49f49cde-2e38-408d-829a-fd72481e5315 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:44:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-49f49cde-2e38-408d-829a-fd72481e5315 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:44:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-49f49cde-2e38-408d-829a-fd72481e5315 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:44:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-49f49cde-2e38-408d-829a-fd72481e5315 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-49f49cde-2e38-408d-829a-fd72481e5315 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.113s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-49f49cde-2e38-408d-829a-fd72481e5315 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:44:28 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-49f49cde-2e38-408d-829a-fd72481e5315 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Retype volume completed successfully. Sep 17 07:44:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Acquiring lock "cinder-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:44:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Lock "cinder-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:44:29 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:44:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Acquiring lock "cinder-quobyte-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:44:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Lock "cinder-quobyte-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c" acquired by "delete_volume" :: waited 0.012s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:44:29 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fc3999-abb3-4f15-8a14-df282421c99e]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:44:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c" returned: 0 in 0.452s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c" returned: 0 in 0.093s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:30 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Lock "cinder-quobyte-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c" released by "delete_volume" :: held 0.706s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:44:30 devstack cinder-volume[83207]: WARNING cinder.quota [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:44:30 devstack cinder-volume[83207]: WARNING cinder.quota [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:44:30 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Created reservations ['5a52deed-0dfb-4abc-82df-61cdda954555', 'ddcad9f8-390a-417c-aafb-f1632bba330d', 'e71774f2-1c02-4e25-9b60-a4274bb8c1a0', 'bd375db4-f98b-4db3-84c9-36f639ecb3d2'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:44:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:44:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:44:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:44:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:44:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:44:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:44:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.112s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:44:31 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:44:31 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Deleted volume successfully. Sep 17 07:44:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e63df1ca-1afa-4f1e-852a-3691a7d12aa2 tempest-VolumeRetypeWithoutMigrationTest-1488211944 None] Lock "cinder-bb6bf1d2-dffb-44c9-b6e5-6ffa9ec77f3c-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:44:40 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=17,cinder:UPDATE=15,cinder:DELETE=1,cinder:INSERT=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:44:41 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=21,cinder:UPDATE=28,cinder:DELETE=5,cinder:INSERT=7 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:45:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:45:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:45:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:45:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:45:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:45:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:45:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:45:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.126s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:45:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:45:41 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Flow 'volume_create_manager' (cd531e78-3d1a-455f-ae4b-560a258d230e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00296844-779f-4444-921b-bf9e2a051fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00296844-779f-4444-921b-bf9e2a051fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1842045828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b02918-940f-4ebf-adf5-83b136eebd41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaba35f58e0a41b3a98d9954eec70c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:45:41Z,use_quota=True,user_id='b98712c7386d4ac792afc4fb60b18c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d650405-6472-4266-8d8f-47bd4e423a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d650405-6472-4266-8d8f-47bd4e423a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a56bd96-7317-44f2-971b-6540bf3f5066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a56bd96-7317-44f2-971b-6540bf3f5066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55b02918-940f-4ebf-adf5-83b136eebd41', 'volume_name': 'volume-55b02918-940f-4ebf-adf5-83b136eebd41', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a205ec-98da-42d3-b9b2-1ca4c319c952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a205ec-98da-42d3-b9b2-1ca4c319c952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd659fc-c335-4b43-898b-8081e9140221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:45:41 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Volume 55b02918-940f-4ebf-adf5-83b136eebd41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55b02918-940f-4ebf-adf5-83b136eebd41', 'volume_size': 1} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1842045828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b02918-940f-4ebf-adf5-83b136eebd41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaba35f58e0a41b3a98d9954eec70c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:45:41Z,use_quota=True,user_id='b98712c7386d4ac792afc4fb60b18c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Creating volume 55b02918-940f-4ebf-adf5-83b136eebd41 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:45:41 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:45:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-55b02918-940f-4ebf-adf5-83b136eebd41 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:45:41 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=58, name=volume-55b02918-940f-4ebf-adf5-83b136eebd41, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:45:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-55b02918-940f-4ebf-adf5-83b136eebd41 1073741824" returned: 0 in 0.550s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:45:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-55b02918-940f-4ebf-adf5-83b136eebd41 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:45:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-55b02918-940f-4ebf-adf5-83b136eebd41" returned: 0 in 0.109s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:45:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] <== create_volume: return (748ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:45:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:45:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dd659fc-c335-4b43-898b-8081e9140221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b02918-940f-4ebf-adf5-83b136eebd41', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:45:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce9eb82-cccf-425d-9ab5-086131666596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:45:42 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Volume volume-55b02918-940f-4ebf-adf5-83b136eebd41 (55b02918-940f-4ebf-adf5-83b136eebd41): created successfully Sep 17 07:45:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce9eb82-cccf-425d-9ab5-086131666596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:45:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Flow 'volume_create_manager' (cd531e78-3d1a-455f-ae4b-560a258d230e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:45:42 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-1cc7f718-ad2d-4e7e-a864-e727f0a9f859 tempest-VolumesActionsTest-159356987 None] Created volume successfully. Sep 17 07:45:43 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d157418a-ebc3-4fae-ae4b-4a8550f1dbfd tempest-VolumesActionsTest-159356987 None] Acquiring lock "cinder-55b02918-940f-4ebf-adf5-83b136eebd41" by "attach_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:45:43 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d157418a-ebc3-4fae-ae4b-4a8550f1dbfd tempest-VolumesActionsTest-159356987 None] Lock "cinder-55b02918-940f-4ebf-adf5-83b136eebd41" acquired by "attach_volume" :: waited 0.066s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:45:43 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-d157418a-ebc3-4fae-ae4b-4a8550f1dbfd tempest-VolumesActionsTest-159356987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:45:43 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d157418a-ebc3-4fae-ae4b-4a8550f1dbfd tempest-VolumesActionsTest-159356987 None] Attaching volume 55b02918-940f-4ebf-adf5-83b136eebd41 to instance 6808f456-cd08-403d-84af-2fd01f604fcf at mountpoint /dev/vdb on host None. Sep 17 07:45:43 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d157418a-ebc3-4fae-ae4b-4a8550f1dbfd tempest-VolumesActionsTest-159356987 None] Attach volume completed successfully. Sep 17 07:45:43 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d157418a-ebc3-4fae-ae4b-4a8550f1dbfd tempest-VolumesActionsTest-159356987 None] Lock "cinder-55b02918-940f-4ebf-adf5-83b136eebd41" released by "attach_volume" :: held 0.435s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:45:45 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4c613ceb-8e6b-4f20-9362-7de76f1834d9 tempest-VolumesActionsTest-873218968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:45:45 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4c613ceb-8e6b-4f20-9362-7de76f1834d9 tempest-VolumesActionsTest-873218968 None] Terminate volume connection completed successfully. Sep 17 07:45:45 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4c613ceb-8e6b-4f20-9362-7de76f1834d9 tempest-VolumesActionsTest-873218968 None] Acquiring lock "cinder-55b02918-940f-4ebf-adf5-83b136eebd41-detach_volume" by "detach_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:45:45 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4c613ceb-8e6b-4f20-9362-7de76f1834d9 tempest-VolumesActionsTest-873218968 None] Lock "cinder-55b02918-940f-4ebf-adf5-83b136eebd41-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:45:45 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4c613ceb-8e6b-4f20-9362-7de76f1834d9 tempest-VolumesActionsTest-873218968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:45:45 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4c613ceb-8e6b-4f20-9362-7de76f1834d9 tempest-VolumesActionsTest-873218968 None] Detaching volume 55b02918-940f-4ebf-adf5-83b136eebd41 from instance 6808f456-cd08-403d-84af-2fd01f604fcf. Sep 17 07:45:45 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4c613ceb-8e6b-4f20-9362-7de76f1834d9 tempest-VolumesActionsTest-873218968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:45:45 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4c613ceb-8e6b-4f20-9362-7de76f1834d9 tempest-VolumesActionsTest-873218968 None] Detach volume completed successfully. Sep 17 07:45:45 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4c613ceb-8e6b-4f20-9362-7de76f1834d9 tempest-VolumesActionsTest-873218968 None] Lock "cinder-55b02918-940f-4ebf-adf5-83b136eebd41-detach_volume" released by "detach_volume" :: held 0.171s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:45:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d1b84626-17da-4f5e-9e5c-32565364e70e tempest-VolumesActionsTest-159356987 None] Acquiring lock "cinder-55b02918-940f-4ebf-adf5-83b136eebd41-detach_volume" by "detach_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:45:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d1b84626-17da-4f5e-9e5c-32565364e70e tempest-VolumesActionsTest-159356987 None] Lock "cinder-55b02918-940f-4ebf-adf5-83b136eebd41-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:45:46 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d1b84626-17da-4f5e-9e5c-32565364e70e tempest-VolumesActionsTest-159356987 None] Volume detach called, but volume not attached. Sep 17 07:45:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d1b84626-17da-4f5e-9e5c-32565364e70e tempest-VolumesActionsTest-159356987 None] Lock "cinder-55b02918-940f-4ebf-adf5-83b136eebd41-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:45:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Acquiring lock "cinder-55b02918-940f-4ebf-adf5-83b136eebd41-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:45:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Lock "cinder-55b02918-940f-4ebf-adf5-83b136eebd41-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:45:47 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:45:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Acquiring lock "cinder-quobyte-55b02918-940f-4ebf-adf5-83b136eebd41" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:45:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Lock "cinder-quobyte-55b02918-940f-4ebf-adf5-83b136eebd41" acquired by "delete_volume" :: waited 0.021s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:45:47 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[446bbf6c-f065-46dd-b82c-90b1c21727ac]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:45:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-55b02918-940f-4ebf-adf5-83b136eebd41 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:45:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-55b02918-940f-4ebf-adf5-83b136eebd41" returned: 0 in 0.510s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:45:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-55b02918-940f-4ebf-adf5-83b136eebd41 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:45:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-55b02918-940f-4ebf-adf5-83b136eebd41" returned: 0 in 0.134s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:45:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Lock "cinder-quobyte-55b02918-940f-4ebf-adf5-83b136eebd41" released by "delete_volume" :: held 0.849s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:45:48 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Created reservations ['43f338b8-7fd1-42f9-8ef6-4b677852a0f1', '0a9168cc-3885-4928-bc8a-1f5244353dce', 'edbb08a3-ac06-40e3-8af5-527cd52a1f83', '75637904-eeb9-46b2-ae4e-1eb314bade85'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:45:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:45:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:45:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:45:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:45:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:45:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:45:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.131s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:45:48 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:45:49 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Deleted volume successfully. Sep 17 07:45:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8f8bca79-66d0-48c1-8f37-9487050cd8b4 tempest-VolumesActionsTest-159356987 None] Lock "cinder-55b02918-940f-4ebf-adf5-83b136eebd41-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:45:58 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Flow 'volume_create_manager' (c524bcc6-9f15-4a77-82ad-616b0d15611b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5cbb91-c2b8-4f6b-8073-9bad64ebf5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5cbb91-c2b8-4f6b-8073-9bad64ebf5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-497689990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ce7f5d-7d51-4a34-af96-a6e7751811cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b6c31b39b441a49e3bec65c7dd729b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:45:58Z,use_quota=True,user_id='46cbd748b39b4028a306b40a9a741c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4a4a4e-63ce-46ab-9bdf-739cc0cf6231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4a4a4e-63ce-46ab-9bdf-739cc0cf6231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e56dbcd-6485-4027-8af6-7bb914639acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e56dbcd-6485-4027-8af6-7bb914639acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ce7f5d-7d51-4a34-af96-a6e7751811cb', 'volume_name': 'volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87af519e-40a1-4a55-b6b0-188ea72e4f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87af519e-40a1-4a55-b6b0-188ea72e4f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128ac7b8-c025-405e-b71f-10574012dcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:45:58 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Volume 57ce7f5d-7d51-4a34-af96-a6e7751811cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb', 'volume_size': 1} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-497689990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ce7f5d-7d51-4a34-af96-a6e7751811cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b6c31b39b441a49e3bec65c7dd729b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:45:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:45:58Z,use_quota=True,user_id='46cbd748b39b4028a306b40a9a741c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Creating volume 57ce7f5d-7d51-4a34-af96-a6e7751811cb {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:45:58 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:45:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:45:58 devstack quobyte-client[83219]: System call of process 94258 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:45:58 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=59, name=volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:45:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb 1073741824" returned: 0 in 0.385s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:45:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:45:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb" returned: 0 in 0.195s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:45:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] <== create_volume: return (640ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:45:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.651s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:45:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (128ac7b8-c025-405e-b71f-10574012dcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:45:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c8a374-2101-4f1a-b888-69b2005d59b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:45:59 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Volume volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb (57ce7f5d-7d51-4a34-af96-a6e7751811cb): created successfully Sep 17 07:45:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c8a374-2101-4f1a-b888-69b2005d59b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:45:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Flow 'volume_create_manager' (c524bcc6-9f15-4a77-82ad-616b0d15611b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:45:59 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-bff94572-0946-4cec-adbf-140e5ededcb1 tempest-AttachVolumeNegativeTest-1634306197 None] Created volume successfully. Sep 17 07:46:00 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Flow 'volume_create_manager' (b9d07293-70ac-424b-b13a-21ca0f8a340b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b45a995-1493-44bc-af2f-bfef2598258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b45a995-1493-44bc-af2f-bfef2598258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-922504241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f3261a-fb9c-43a3-8555-be2afc435d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaba35f58e0a41b3a98d9954eec70c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:00Z,use_quota=True,user_id='b98712c7386d4ac792afc4fb60b18c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589fb266-23b1-4dc7-a8ad-afcc39f97f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589fb266-23b1-4dc7-a8ad-afcc39f97f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fc8f27-6a10-4144-9be6-3d0d10cd20af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fc8f27-6a10-4144-9be6-3d0d10cd20af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42f3261a-fb9c-43a3-8555-be2afc435d64', 'volume_name': 'volume-42f3261a-fb9c-43a3-8555-be2afc435d64', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64cc067-9cfb-43fc-a91f-a553b9e57cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64cc067-9cfb-43fc-a91f-a553b9e57cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2214ab48-0b6f-4d56-b069-5e4374a19668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:00 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Volume 42f3261a-fb9c-43a3-8555-be2afc435d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42f3261a-fb9c-43a3-8555-be2afc435d64', 'volume_size': 1} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-922504241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f3261a-fb9c-43a3-8555-be2afc435d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaba35f58e0a41b3a98d9954eec70c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:00Z,use_quota=True,user_id='b98712c7386d4ac792afc4fb60b18c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Creating volume 42f3261a-fb9c-43a3-8555-be2afc435d64 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:46:00 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:46:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-42f3261a-fb9c-43a3-8555-be2afc435d64 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:00 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=60, name=volume-42f3261a-fb9c-43a3-8555-be2afc435d64, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:46:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-42f3261a-fb9c-43a3-8555-be2afc435d64 1073741824" returned: 0 in 0.480s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-42f3261a-fb9c-43a3-8555-be2afc435d64 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-42f3261a-fb9c-43a3-8555-be2afc435d64" returned: 0 in 0.140s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] <== create_volume: return (701ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:46:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2214ab48-0b6f-4d56-b069-5e4374a19668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f3261a-fb9c-43a3-8555-be2afc435d64', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00212d36-2383-481b-940b-ca5ec2c35acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:01 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Volume volume-42f3261a-fb9c-43a3-8555-be2afc435d64 (42f3261a-fb9c-43a3-8555-be2afc435d64): created successfully Sep 17 07:46:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00212d36-2383-481b-940b-ca5ec2c35acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Flow 'volume_create_manager' (b9d07293-70ac-424b-b13a-21ca0f8a340b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:46:01 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-bf8c0f40-d799-4cbe-b0fe-bbcc93805ad9 tempest-VolumesActionsTest-159356987 None] Created volume successfully. Sep 17 07:46:02 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Acquiring lock "cinder-42f3261a-fb9c-43a3-8555-be2afc435d64-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:46:02 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Lock "cinder-42f3261a-fb9c-43a3-8555-be2afc435d64-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:46:02 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:46:02 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Acquiring lock "cinder-quobyte-42f3261a-fb9c-43a3-8555-be2afc435d64" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:46:02 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Lock "cinder-quobyte-42f3261a-fb9c-43a3-8555-be2afc435d64" acquired by "delete_volume" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:46:02 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[44606b6e-d27d-4b55-8dfa-e09afce7cd46]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:46:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-42f3261a-fb9c-43a3-8555-be2afc435d64 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-42f3261a-fb9c-43a3-8555-be2afc435d64" returned: 0 in 0.541s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-42f3261a-fb9c-43a3-8555-be2afc435d64 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-42f3261a-fb9c-43a3-8555-be2afc435d64" returned: 0 in 0.091s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:03 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Lock "cinder-quobyte-42f3261a-fb9c-43a3-8555-be2afc435d64" released by "delete_volume" :: held 0.867s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:46:04 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Created reservations ['71f243c2-6589-466c-a4d1-847ab01b6691', 'dd1211f2-7187-41b0-91d5-68712d3a9ff3', '2e42a294-dd8c-4950-a89a-79978122dbf4', '1810077a-4c08-4bb7-8ca8-a0e244774715'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:46:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:04 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:46:04 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:46:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.140s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:04 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:46:04 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Deleted volume successfully. Sep 17 07:46:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cba98eb3-ca70-410c-9b8a-bb4219e1ca4a tempest-VolumesActionsTest-873218968 None] Lock "cinder-42f3261a-fb9c-43a3-8555-be2afc435d64-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:46:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-7d70057f-b971-46b0-aa9a-1f4195c09633 req-eb7c0752-10c2-44cb-a40d-539acb5caf60 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-7d70057f-b971-46b0-aa9a-1f4195c09633 req-eb7c0752-10c2-44cb-a40d-539acb5caf60 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:05 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[451a653c-f00c-4c10-af68-46a02f3e8c1d]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:46:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-7d70057f-b971-46b0-aa9a-1f4195c09633 req-eb7c0752-10c2-44cb-a40d-539acb5caf60 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:05 devstack quobyte-client[83219]: System call of process 94289 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-7d70057f-b971-46b0-aa9a-1f4195c09633 req-eb7c0752-10c2-44cb-a40d-539acb5caf60 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb" returned: 0 in 0.703s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-7d70057f-b971-46b0-aa9a-1f4195c09633 req-eb7c0752-10c2-44cb-a40d-539acb5caf60 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.745s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:06 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Flow 'volume_create_manager' (3ec7c852-720a-44d3-b89b-3e02356bb925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d528a3-bf00-424c-9cbc-e984f263c69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d528a3-bf00-424c-9cbc-e984f263c69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-629612208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704722e7-9ecd-467b-9ea8-7210be77f9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaba35f58e0a41b3a98d9954eec70c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:06Z,use_quota=True,user_id='b98712c7386d4ac792afc4fb60b18c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73209ffd-0ac3-474c-b8fc-9835403d9916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73209ffd-0ac3-474c-b8fc-9835403d9916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ba30f4-996c-4428-92c9-08506f8a069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ba30f4-996c-4428-92c9-08506f8a069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '704722e7-9ecd-467b-9ea8-7210be77f9bf', 'volume_name': 'volume-704722e7-9ecd-467b-9ea8-7210be77f9bf', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88ae134-73ec-47fa-a81d-49d7f77bd5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88ae134-73ec-47fa-a81d-49d7f77bd5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c955b6-e6a2-4496-b50f-64ca53effd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:06 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Volume 704722e7-9ecd-467b-9ea8-7210be77f9bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-704722e7-9ecd-467b-9ea8-7210be77f9bf', 'volume_size': 1} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-629612208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704722e7-9ecd-467b-9ea8-7210be77f9bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaba35f58e0a41b3a98d9954eec70c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:06Z,use_quota=True,user_id='b98712c7386d4ac792afc4fb60b18c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Creating volume 704722e7-9ecd-467b-9ea8-7210be77f9bf {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:46:06 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-704722e7-9ecd-467b-9ea8-7210be77f9bf 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:06 devstack quobyte-client[83219]: System call of process 94292 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:46:06 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=61, name=volume-704722e7-9ecd-467b-9ea8-7210be77f9bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-7d70057f-b971-46b0-aa9a-1f4195c09633 req-eb7c0752-10c2-44cb-a40d-539acb5caf60 tempest-AttachVolumeNegativeTest-1634306197 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4eeb0eb7-df5c-4b17-9d83-9364ec0ba96a', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:46:06 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-7d70057f-b971-46b0-aa9a-1f4195c09633 req-eb7c0752-10c2-44cb-a40d-539acb5caf60 tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-704722e7-9ecd-467b-9ea8-7210be77f9bf 1073741824" returned: 0 in 0.460s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-704722e7-9ecd-467b-9ea8-7210be77f9bf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-704722e7-9ecd-467b-9ea8-7210be77f9bf" returned: 0 in 0.336s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] <== create_volume: return (828ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:46:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:07 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-7d70057f-b971-46b0-aa9a-1f4195c09633 req-eb7c0752-10c2-44cb-a40d-539acb5caf60 tempest-AttachVolumeNegativeTest-1634306197 None] attachment_update completed successfully. Sep 17 07:46:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c955b6-e6a2-4496-b50f-64ca53effd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-704722e7-9ecd-467b-9ea8-7210be77f9bf', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56779b8-83f6-4e08-8419-95de4d4be516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:07 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Volume volume-704722e7-9ecd-467b-9ea8-7210be77f9bf (704722e7-9ecd-467b-9ea8-7210be77f9bf): created successfully Sep 17 07:46:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56779b8-83f6-4e08-8419-95de4d4be516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:07 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Flow 'volume_create_manager' (3ec7c852-720a-44d3-b89b-3e02356bb925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:46:07 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-0779d385-9b10-498e-b52a-60724ffc6b91 tempest-VolumesActionsTest-159356987 None] Created volume successfully. Sep 17 07:46:08 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Acquiring lock "cinder-704722e7-9ecd-467b-9ea8-7210be77f9bf-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:46:08 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Lock "cinder-704722e7-9ecd-467b-9ea8-7210be77f9bf-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:46:08 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:46:08 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Acquiring lock "cinder-quobyte-704722e7-9ecd-467b-9ea8-7210be77f9bf" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:46:08 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Lock "cinder-quobyte-704722e7-9ecd-467b-9ea8-7210be77f9bf" acquired by "delete_volume" :: waited 0.019s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:46:08 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f85875f-9ee2-4925-843c-4059f1bcd85a]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:46:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-704722e7-9ecd-467b-9ea8-7210be77f9bf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-704722e7-9ecd-467b-9ea8-7210be77f9bf" returned: 0 in 0.464s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-704722e7-9ecd-467b-9ea8-7210be77f9bf {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-704722e7-9ecd-467b-9ea8-7210be77f9bf" returned: 0 in 0.149s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:09 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Lock "cinder-quobyte-704722e7-9ecd-467b-9ea8-7210be77f9bf" released by "delete_volume" :: held 0.857s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:46:09 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Created reservations ['992aa3c6-11ad-4f77-afa7-31a3ced16b43', 'cb0a18ce-98a3-41b2-a2c0-6817c7a68493', 'cec5e2ff-aaef-46f3-9277-f8fb05dee17c', 'bf3327e6-e7b5-4f19-8e32-7adc949f3040'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:46:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:46:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:46:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.132s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:10 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:46:10 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Deleted volume successfully. Sep 17 07:46:11 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d9cf5fd9-bd22-421c-929e-de8670c77fd3 tempest-VolumesActionsTest-873218968 None] Lock "cinder-704722e7-9ecd-467b-9ea8-7210be77f9bf-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:46:11 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:46:11 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:46:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Flow 'volume_create_manager' (fb146b89-76d9-467f-9a00-1a886a1b4e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:46:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f05907-aabf-4769-8b84-53e516f919d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f05907-aabf-4769-8b84-53e516f919d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1974535183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ad4904-845a-46df-9a74-9e0a1d970b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaba35f58e0a41b3a98d9954eec70c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:12Z,use_quota=True,user_id='b98712c7386d4ac792afc4fb60b18c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002dbcca-7ef0-4173-9fe3-bcc8058ea432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002dbcca-7ef0-4173-9fe3-bcc8058ea432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5bf00c4-66a4-4feb-aaa7-e2c5cab92b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5bf00c4-66a4-4feb-aaa7-e2c5cab92b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5ad4904-845a-46df-9a74-9e0a1d970b79', 'volume_name': 'volume-a5ad4904-845a-46df-9a74-9e0a1d970b79', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4207da6-9a1c-4d91-93b9-9afce019a218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4207da6-9a1c-4d91-93b9-9afce019a218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edfa979-1e77-4b5b-bd6e-f37c9cd2c514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:12 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Volume a5ad4904-845a-46df-9a74-9e0a1d970b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5ad4904-845a-46df-9a74-9e0a1d970b79', 'volume_size': 1} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1974535183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ad4904-845a-46df-9a74-9e0a1d970b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaba35f58e0a41b3a98d9954eec70c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:12Z,use_quota=True,user_id='b98712c7386d4ac792afc4fb60b18c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Creating volume a5ad4904-845a-46df-9a74-9e0a1d970b79 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:46:12 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a5ad4904-845a-46df-9a74-9e0a1d970b79 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:12 devstack quobyte-client[83219]: System call of process 94719 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:46:12 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=62, name=volume-a5ad4904-845a-46df-9a74-9e0a1d970b79, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a5ad4904-845a-46df-9a74-9e0a1d970b79 1073741824" returned: 0 in 0.370s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a5ad4904-845a-46df-9a74-9e0a1d970b79 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a5ad4904-845a-46df-9a74-9e0a1d970b79" returned: 0 in 0.098s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] <== create_volume: return (548ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.562s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edfa979-1e77-4b5b-bd6e-f37c9cd2c514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5ad4904-845a-46df-9a74-9e0a1d970b79', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394294c1-7e0c-4d04-bc5e-1b63adad39ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:12 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Volume volume-a5ad4904-845a-46df-9a74-9e0a1d970b79 (a5ad4904-845a-46df-9a74-9e0a1d970b79): created successfully Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394294c1-7e0c-4d04-bc5e-1b63adad39ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Flow 'volume_create_manager' (fb146b89-76d9-467f-9a00-1a886a1b4e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:46:13 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ba66ae8e-b24e-4177-865b-99e6fbce298d tempest-VolumesActionsTest-159356987 None] Created volume successfully. Sep 17 07:46:14 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Acquiring lock "cinder-a5ad4904-845a-46df-9a74-9e0a1d970b79-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:46:14 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Lock "cinder-a5ad4904-845a-46df-9a74-9e0a1d970b79-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:46:14 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:46:14 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Acquiring lock "cinder-quobyte-a5ad4904-845a-46df-9a74-9e0a1d970b79" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:46:14 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Lock "cinder-quobyte-a5ad4904-845a-46df-9a74-9e0a1d970b79" acquired by "delete_volume" :: waited 0.014s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:46:14 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dc8a82-fce7-42bd-8291-f1e89473dac0]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:46:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a5ad4904-845a-46df-9a74-9e0a1d970b79 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a5ad4904-845a-46df-9a74-9e0a1d970b79" returned: 0 in 0.479s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a5ad4904-845a-46df-9a74-9e0a1d970b79 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a5ad4904-845a-46df-9a74-9e0a1d970b79" returned: 0 in 0.125s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Lock "cinder-quobyte-a5ad4904-845a-46df-9a74-9e0a1d970b79" released by "delete_volume" :: held 0.789s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:46:15 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Created reservations ['2ad82fc3-6a88-4fb8-8a17-69655ed8e994', '02b67a48-fd72-4e08-9fea-536602dafa6a', 'a44e50e7-7a0e-4294-8963-b2cad4dd9466', '798252e4-89a0-41a6-99e4-2dd661c08657'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:46:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:46:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:46:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.110s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:15 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:46:15 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Deleted volume successfully. Sep 17 07:46:16 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f585e944-4e19-45e2-aae9-4840f205f09c tempest-VolumesActionsTest-873218968 None] Lock "cinder-a5ad4904-845a-46df-9a74-9e0a1d970b79-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:46:17 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Flow 'volume_create_manager' (0f504f73-e2a0-4392-be41-ae239d4e3173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b55c09b-de7f-4646-858e-99a49f0a2b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b55c09b-de7f-4646-858e-99a49f0a2b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1197211799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ab1c3a-1d2e-41e7-b936-c219f16dfa64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaba35f58e0a41b3a98d9954eec70c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:17Z,use_quota=True,user_id='b98712c7386d4ac792afc4fb60b18c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ebb6a8-3bfd-412f-b351-c48d92168962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ebb6a8-3bfd-412f-b351-c48d92168962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456a1f4c-ebd8-4931-9497-fc334c43e6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456a1f4c-ebd8-4931-9497-fc334c43e6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90ab1c3a-1d2e-41e7-b936-c219f16dfa64', 'volume_name': 'volume-90ab1c3a-1d2e-41e7-b936-c219f16dfa64', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee474b8-9c1b-4ad5-9181-5e47374e215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee474b8-9c1b-4ad5-9181-5e47374e215f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b054008d-6dfe-41b8-9d87-e43e303b2f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:17 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Volume 90ab1c3a-1d2e-41e7-b936-c219f16dfa64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90ab1c3a-1d2e-41e7-b936-c219f16dfa64', 'volume_size': 1} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1197211799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ab1c3a-1d2e-41e7-b936-c219f16dfa64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaba35f58e0a41b3a98d9954eec70c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:17Z,use_quota=True,user_id='b98712c7386d4ac792afc4fb60b18c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Creating volume 90ab1c3a-1d2e-41e7-b936-c219f16dfa64 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:46:17 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-90ab1c3a-1d2e-41e7-b936-c219f16dfa64 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:17 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=63, name=volume-90ab1c3a-1d2e-41e7-b936-c219f16dfa64, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-90ab1c3a-1d2e-41e7-b936-c219f16dfa64 1073741824" returned: 0 in 0.414s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-90ab1c3a-1d2e-41e7-b936-c219f16dfa64 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-90ab1c3a-1d2e-41e7-b936-c219f16dfa64" returned: 0 in 0.098s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] <== create_volume: return (611ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:46:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.625s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b054008d-6dfe-41b8-9d87-e43e303b2f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90ab1c3a-1d2e-41e7-b936-c219f16dfa64', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f604aba-1742-4bf5-bb49-c0b34e3fb520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:18 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Volume volume-90ab1c3a-1d2e-41e7-b936-c219f16dfa64 (90ab1c3a-1d2e-41e7-b936-c219f16dfa64): created successfully Sep 17 07:46:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f604aba-1742-4bf5-bb49-c0b34e3fb520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Flow 'volume_create_manager' (0f504f73-e2a0-4392-be41-ae239d4e3173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:46:18 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e9cfc956-aa4c-4ba8-85a6-241bc17b8c0d tempest-VolumesActionsTest-159356987 None] Created volume successfully. Sep 17 07:46:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Acquiring lock "cinder-90ab1c3a-1d2e-41e7-b936-c219f16dfa64-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:46:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Lock "cinder-90ab1c3a-1d2e-41e7-b936-c219f16dfa64-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:46:19 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:46:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Acquiring lock "cinder-quobyte-90ab1c3a-1d2e-41e7-b936-c219f16dfa64" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:46:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Lock "cinder-quobyte-90ab1c3a-1d2e-41e7-b936-c219f16dfa64" acquired by "delete_volume" :: waited 0.012s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:46:19 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf40a11-68ed-442b-ae16-be61129c7dfc]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:46:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-90ab1c3a-1d2e-41e7-b936-c219f16dfa64 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-90ab1c3a-1d2e-41e7-b936-c219f16dfa64" returned: 0 in 0.494s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-90ab1c3a-1d2e-41e7-b936-c219f16dfa64 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-90ab1c3a-1d2e-41e7-b936-c219f16dfa64" returned: 0 in 0.089s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:20 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Lock "cinder-quobyte-90ab1c3a-1d2e-41e7-b936-c219f16dfa64" released by "delete_volume" :: held 0.765s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:46:20 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Created reservations ['413a82f3-d441-42dd-98d2-9ade97df0c98', 'd6cdc123-37dd-4151-8938-2347c90e956b', '04d7d3e3-5292-40ba-ace8-2e456770c036', '4371ad71-6379-476a-bda6-73e2208c8bf5'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:46:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:46:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:46:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.153s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:21 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:46:21 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Deleted volume successfully. Sep 17 07:46:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ec7bd83d-9973-4016-9f1d-f6d95b7cae4d tempest-VolumesActionsTest-873218968 None] Lock "cinder-90ab1c3a-1d2e-41e7-b936-c219f16dfa64-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:46:22 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Flow 'volume_create_manager' (fa45e872-e07d-484f-8d6e-08c13dbd0f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab18726-9b75-4201-aabe-f9942f9c733c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab18726-9b75-4201-aabe-f9942f9c733c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-209046070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b88687a-35bf-4172-8cc3-1a5df6b57492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaba35f58e0a41b3a98d9954eec70c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:22Z,use_quota=True,user_id='b98712c7386d4ac792afc4fb60b18c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e3f0b8-fa4e-401b-b269-735e119572d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e3f0b8-fa4e-401b-b269-735e119572d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f733d760-3c1a-48f8-85f6-ab324df035fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f733d760-3c1a-48f8-85f6-ab324df035fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b88687a-35bf-4172-8cc3-1a5df6b57492', 'volume_name': 'volume-3b88687a-35bf-4172-8cc3-1a5df6b57492', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b60c39e-9f68-452e-a4a4-1b0e078d6470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b60c39e-9f68-452e-a4a4-1b0e078d6470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d412a0-f294-4a90-a73d-50ec8488d7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:22 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Volume 3b88687a-35bf-4172-8cc3-1a5df6b57492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b88687a-35bf-4172-8cc3-1a5df6b57492', 'volume_size': 1} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-209046070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b88687a-35bf-4172-8cc3-1a5df6b57492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaba35f58e0a41b3a98d9954eec70c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:22Z,use_quota=True,user_id='b98712c7386d4ac792afc4fb60b18c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Creating volume 3b88687a-35bf-4172-8cc3-1a5df6b57492 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:46:22 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b88687a-35bf-4172-8cc3-1a5df6b57492 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:22 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=64, name=volume-3b88687a-35bf-4172-8cc3-1a5df6b57492, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b88687a-35bf-4172-8cc3-1a5df6b57492 1073741824" returned: 0 in 0.360s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b88687a-35bf-4172-8cc3-1a5df6b57492 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b88687a-35bf-4172-8cc3-1a5df6b57492" returned: 0 in 0.138s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] <== create_volume: return (570ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:46:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.583s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d412a0-f294-4a90-a73d-50ec8488d7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b88687a-35bf-4172-8cc3-1a5df6b57492', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb96d496-247c-45f0-915c-ef1509b8e13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:23 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Volume volume-3b88687a-35bf-4172-8cc3-1a5df6b57492 (3b88687a-35bf-4172-8cc3-1a5df6b57492): created successfully Sep 17 07:46:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb96d496-247c-45f0-915c-ef1509b8e13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Flow 'volume_create_manager' (fa45e872-e07d-484f-8d6e-08c13dbd0f35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:46:23 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-f694d66d-69de-451c-a51a-da7576b2e7a8 tempest-VolumesActionsTest-159356987 None] Created volume successfully. Sep 17 07:46:25 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Acquiring lock "cinder-3b88687a-35bf-4172-8cc3-1a5df6b57492-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:46:25 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Lock "cinder-3b88687a-35bf-4172-8cc3-1a5df6b57492-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:46:25 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:46:25 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Acquiring lock "cinder-quobyte-3b88687a-35bf-4172-8cc3-1a5df6b57492" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:46:25 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Lock "cinder-quobyte-3b88687a-35bf-4172-8cc3-1a5df6b57492" acquired by "delete_volume" :: waited 0.015s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:46:25 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[253f6f6e-d86f-4e17-8946-aeaefbafb429]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:46:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b88687a-35bf-4172-8cc3-1a5df6b57492 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:26 devstack quobyte-client[83219]: System call of process 94744 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:46:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b88687a-35bf-4172-8cc3-1a5df6b57492" returned: 0 in 0.615s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b88687a-35bf-4172-8cc3-1a5df6b57492 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b88687a-35bf-4172-8cc3-1a5df6b57492" returned: 0 in 0.140s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Lock "cinder-quobyte-3b88687a-35bf-4172-8cc3-1a5df6b57492" released by "delete_volume" :: held 1.068s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Created reservations ['801272c2-94b0-4e65-9022-b22e084ace9b', '7c9b7e68-75e8-44ff-92dd-d5aacff3a303', '09a44c9d-931f-420f-be59-1ca398eafb24', '8605c57d-5dba-4abc-b110-b7678eb178b7'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.159s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:46:27 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Deleted volume successfully. Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.340s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:46:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-36fab993-ba21-4143-b107-2ca519f91b22 tempest-VolumesActionsTest-159356987 None] Lock "cinder-3b88687a-35bf-4172-8cc3-1a5df6b57492-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:46:37 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=54,cinder:UPDATE=66,cinder:INSERT=13,cinder:DELETE=8 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:46:38 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=47,cinder:UPDATE=69,cinder:DELETE=5,cinder:INSERT=13 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:46:52 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Flow 'volume_create_manager' (f6d284aa-f9e9-4bb3-91b9-886dfd6b8e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03713eaf-abcf-4d13-a303-44110f892b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03713eaf-abcf-4d13-a303-44110f892b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-62977092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8372fcf3-d105-4c56-aaa0-85fcd04565e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68e15d4fd03435995136eecdca0344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:52Z,use_quota=True,user_id='cc4a2223c2aa4302915622a8fc693ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539c82b0-b2e3-48db-87b0-cffdd52afc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539c82b0-b2e3-48db-87b0-cffdd52afc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919133f2-fdc9-4020-884f-67a55fb8551f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919133f2-fdc9-4020-884f-67a55fb8551f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8372fcf3-d105-4c56-aaa0-85fcd04565e3', 'volume_name': 'volume-8372fcf3-d105-4c56-aaa0-85fcd04565e3', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561618df-6ac6-42e5-9384-82a938fc1f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561618df-6ac6-42e5-9384-82a938fc1f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4164e5e2-24fb-4402-a3ee-1934c4880bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:52 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Volume 8372fcf3-d105-4c56-aaa0-85fcd04565e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8372fcf3-d105-4c56-aaa0-85fcd04565e3', 'volume_size': 1} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-62977092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8372fcf3-d105-4c56-aaa0-85fcd04565e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68e15d4fd03435995136eecdca0344a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:46:52Z,use_quota=True,user_id='cc4a2223c2aa4302915622a8fc693ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Creating volume 8372fcf3-d105-4c56-aaa0-85fcd04565e3 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:46:52 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8372fcf3-d105-4c56-aaa0-85fcd04565e3 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:52 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=65, name=volume-8372fcf3-d105-4c56-aaa0-85fcd04565e3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8372fcf3-d105-4c56-aaa0-85fcd04565e3 1073741824" returned: 0 in 0.411s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8372fcf3-d105-4c56-aaa0-85fcd04565e3 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8372fcf3-d105-4c56-aaa0-85fcd04565e3" returned: 0 in 0.089s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:53 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] <== create_volume: return (585ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:46:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.599s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:53 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4164e5e2-24fb-4402-a3ee-1934c4880bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8372fcf3-d105-4c56-aaa0-85fcd04565e3', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:53 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e59de8-3a0c-423f-9e31-abb4afe73543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:46:53 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Volume volume-8372fcf3-d105-4c56-aaa0-85fcd04565e3 (8372fcf3-d105-4c56-aaa0-85fcd04565e3): created successfully Sep 17 07:46:53 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e59de8-3a0c-423f-9e31-abb4afe73543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:46:53 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Flow 'volume_create_manager' (f6d284aa-f9e9-4bb3-91b9-886dfd6b8e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:46:53 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c35d5dce-31ad-4a23-86f5-10771755a6e4 tempest-AbsoluteLimitsTests-1309103775 None] Created volume successfully. Sep 17 07:46:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Acquiring lock "cinder-8372fcf3-d105-4c56-aaa0-85fcd04565e3-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:46:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Lock "cinder-8372fcf3-d105-4c56-aaa0-85fcd04565e3-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:46:54 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:46:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Acquiring lock "cinder-quobyte-8372fcf3-d105-4c56-aaa0-85fcd04565e3" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:46:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Lock "cinder-quobyte-8372fcf3-d105-4c56-aaa0-85fcd04565e3" acquired by "delete_volume" :: waited 0.017s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:46:54 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60587b1-dc5d-4a72-ad76-9c4ed023bc23]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:46:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8372fcf3-d105-4c56-aaa0-85fcd04565e3 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8372fcf3-d105-4c56-aaa0-85fcd04565e3" returned: 0 in 0.413s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8372fcf3-d105-4c56-aaa0-85fcd04565e3 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8372fcf3-d105-4c56-aaa0-85fcd04565e3" returned: 0 in 0.125s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Lock "cinder-quobyte-8372fcf3-d105-4c56-aaa0-85fcd04565e3" released by "delete_volume" :: held 0.777s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:46:55 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Created reservations ['5a9e017e-6cea-42db-a126-49fbc3ec34ec', 'fdcbefa1-10fb-4e34-9548-873b41aba410', 'ebab7390-9318-4dd1-804a-c98b0eaaa5f8', '11ce9084-67db-4a9a-bb61-c1d74fdfb1cf'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:46:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:46:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:46:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:46:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:46:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:46:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:46:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.117s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:46:56 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:46:56 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Deleted volume successfully. Sep 17 07:46:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1c8f614c-2e93-492d-ad4b-122a5c13c7b9 tempest-AbsoluteLimitsTests-1309103775 None] Lock "cinder-8372fcf3-d105-4c56-aaa0-85fcd04565e3-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:02 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Flow 'volume_create_manager' (370983c1-ee34-4f51-909d-e3094825c036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8144a9-3e69-4db7-99b9-8b3cc0c4d414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8144a9-3e69-4db7-99b9-8b3cc0c4d414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1340634903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d455fdbc-6e3e-4f0b-9016-259278bb119c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80206cf37b748c889048edadb2ce8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:47:02Z,use_quota=True,user_id='b48d4b128b8743519efed6d6cfe4a812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac14a5b-ff19-4cfa-aa31-480a939b0a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac14a5b-ff19-4cfa-aa31-480a939b0a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd01e91-57f1-473b-96f7-0f0fe782adff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd01e91-57f1-473b-96f7-0f0fe782adff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd455fdbc-6e3e-4f0b-9016-259278bb119c', 'volume_name': 'volume-d455fdbc-6e3e-4f0b-9016-259278bb119c', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b250d3b-06fb-4d6e-aaef-cc62a66d4dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b250d3b-06fb-4d6e-aaef-cc62a66d4dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97a8dcc-da49-4afc-bcb8-fedcc192e957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:02 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Volume d455fdbc-6e3e-4f0b-9016-259278bb119c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d455fdbc-6e3e-4f0b-9016-259278bb119c', 'volume_size': 1} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1340634903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d455fdbc-6e3e-4f0b-9016-259278bb119c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80206cf37b748c889048edadb2ce8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:47:02Z,use_quota=True,user_id='b48d4b128b8743519efed6d6cfe4a812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Creating volume d455fdbc-6e3e-4f0b-9016-259278bb119c {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:47:02 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:47:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:03 devstack quobyte-client[83219]: System call of process 94897 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:47:03 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=66, name=volume-d455fdbc-6e3e-4f0b-9016-259278bb119c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:47:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c 1073741824" returned: 0 in 0.492s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c" returned: 0 in 0.198s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] <== create_volume: return (806ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:47:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97a8dcc-da49-4afc-bcb8-fedcc192e957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d455fdbc-6e3e-4f0b-9016-259278bb119c', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dec07d9-1b7c-4717-95af-ea4ec8b4f7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:04 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Volume volume-d455fdbc-6e3e-4f0b-9016-259278bb119c (d455fdbc-6e3e-4f0b-9016-259278bb119c): created successfully Sep 17 07:47:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dec07d9-1b7c-4717-95af-ea4ec8b4f7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Flow 'volume_create_manager' (370983c1-ee34-4f51-909d-e3094825c036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:47:04 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-eacaa1d3-efb7-44aa-966d-d1348a2dabe7 tempest-VolumesDeleteCascade-584087184 None] Created volume successfully. Sep 17 07:47:05 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] Creating offline snapshot 8ba60fde-f6bb-4829-a68f-e97cc6a447a2 of volume d455fdbc-6e3e-4f0b-9016-259278bb119c {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:47:05 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebafe0cd-814e-44e4-9f11-56802ce93bd0]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c" returned: 0 in 0.477s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:06 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=67, name=volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:47:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 1G" returned: 0 in 0.327s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d455fdbc-6e3e-4f0b-9016-259278bb119c -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] CMD "qemu-img rebase -u -b volume-d455fdbc-6e3e-4f0b-9016-259278bb119c -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2" returned: 0 in 0.238s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:47:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2" returned: 0 in 0.096s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:47:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2" returned: 0 in 0.126s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.info" returned: 0 in 0.147s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:47:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.info" returned: 0 in 0.147s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:07 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-15cb4a8b-880a-4645-a556-500ae1cead8c tempest-VolumesDeleteCascade-584087184 None] Create snapshot completed successfully Sep 17 07:47:09 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] Creating offline snapshot c453eaa9-5646-4950-aee5-2e1a47caf0ab of volume d455fdbc-6e3e-4f0b-9016-259278bb119c {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:47:09 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[96675405-4ee4-4028-976a-50cb08ac3428]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2" returned: 0 in 0.450s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d455fdbc-6e3e-4f0b-9016-259278bb119c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:47:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:09 devstack quobyte-client[83219]: System call of process 94920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:47:09 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=69, name=volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:47:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab 1G" returned: 0 in 0.409s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] CMD "qemu-img rebase -u -b volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab" returned: 0 in 0.151s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:47:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab" returned: 0 in 0.097s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:47:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab" returned: 0 in 0.111s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.602s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:10 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b9dd6bb8-d433-419b-8d77-a843956d95ff tempest-VolumesDeleteCascade-584087184 None] Create snapshot completed successfully Sep 17 07:47:11 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-d455fdbc-6e3e-4f0b-9016-259278bb119c-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:11 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-d455fdbc-6e3e-4f0b-9016-259278bb119c-delete_volume" acquired by "delete_volume" :: waited 0.181s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:11 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Performing cascade delete. {{(pid=83207) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 07:47:11 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-8ba60fde-f6bb-4829-a68f-e97cc6a447a2-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:11 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-8ba60fde-f6bb-4829-a68f-e97cc6a447a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:11 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:11 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-quobyte-d455fdbc-6e3e-4f0b-9016-259278bb119c" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:11 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-d455fdbc-6e3e-4f0b-9016-259278bb119c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:11 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-quobyte-8ba60fde-f6bb-4829-a68f-e97cc6a447a2" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:11 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-8ba60fde-f6bb-4829-a68f-e97cc6a447a2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:11 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Deleting offline snapshot 8ba60fde-f6bb-4829-a68f-e97cc6a447a2 of volume d455fdbc-6e3e-4f0b-9016-259278bb119c {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:47:11 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] snapshot_file for this snap is: volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:47:12 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e893bfb1-0a95-43e2-bcc2-8d9b2cb0da16]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2" returned: 0 in 0.533s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d455fdbc-6e3e-4f0b-9016-259278bb119c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:47:12 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bfab45-5196-471b-aadd-55bfbd08d05d]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c" returned: 0 in 0.449s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:13 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c2024f-b3f9-4c6d-9445-fdf40f6ebac6]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab" returned: 0 in 0.397s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d455fdbc-6e3e-4f0b-9016-259278bb119c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:47:13 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0837ad30-feb0-4da4-b7f3-4c37f9245023]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2" returned: 0 in 0.487s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d455fdbc-6e3e-4f0b-9016-259278bb119c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:47:14 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[188a2d6f-fc51-4b9a-8a97-2d8d51d65baf]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c" returned: 0 in 0.494s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2" returned: 0 in 0.213s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.8ba60fde-f6bb-4829-a68f-e97cc6a447a2" returned: 0 in 0.120s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d455fdbc-6e3e-4f0b-9016-259278bb119c /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab -F qcow2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "qemu-img rebase -u -b volume-d455fdbc-6e3e-4f0b-9016-259278bb119c /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab -F qcow2" returned: 0 in 0.155s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-8ba60fde-f6bb-4829-a68f-e97cc6a447a2" released by "_delete_snapshot" :: held 3.450s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-d455fdbc-6e3e-4f0b-9016-259278bb119c" released by "delete_snapshot" :: held 3.486s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:15 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Created reservations ['806e5cbf-fdb4-4d75-a7e3-ad14234d728e', '13486fd4-60ac-48e7-95ac-03ba6417279f', '7e13a0f0-abc1-4c72-887d-808b7775b80a', '559d949a-4afe-4b12-b8e8-df5f305a3715'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:47:15 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Delete snapshot completed successfully. Sep 17 07:47:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-8ba60fde-f6bb-4829-a68f-e97cc6a447a2-delete_snapshot" released by "delete_snapshot" :: held 4.025s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-c453eaa9-5646-4950-aee5-2e1a47caf0ab-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-c453eaa9-5646-4950-aee5-2e1a47caf0ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:15 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-quobyte-d455fdbc-6e3e-4f0b-9016-259278bb119c" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-d455fdbc-6e3e-4f0b-9016-259278bb119c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-quobyte-c453eaa9-5646-4950-aee5-2e1a47caf0ab" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-c453eaa9-5646-4950-aee5-2e1a47caf0ab" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Deleting offline snapshot c453eaa9-5646-4950-aee5-2e1a47caf0ab of volume d455fdbc-6e3e-4f0b-9016-259278bb119c {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:47:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] snapshot_file for this snap is: volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:47:16 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5991a0bc-7752-474f-bdf5-ae5e5804e0a6]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:16 devstack quobyte-client[83219]: System call of process 94992 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:47:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab" returned: 0 in 0.389s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d455fdbc-6e3e-4f0b-9016-259278bb119c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:47:16 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ec8eb-bdfb-4659-a4d5-2f961cd02a21]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c" returned: 0 in 0.452s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:17 devstack quobyte-client[83219]: System call of process 94998 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:47:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab" returned: 0 in 0.206s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c.c453eaa9-5646-4950-aee5-2e1a47caf0ab" returned: 0 in 0.098s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-c453eaa9-5646-4950-aee5-2e1a47caf0ab" released by "_delete_snapshot" :: held 1.504s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-d455fdbc-6e3e-4f0b-9016-259278bb119c" released by "delete_snapshot" :: held 1.535s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:17 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Created reservations ['d99d3ba2-1da2-4e95-9249-f10da6416e1b', 'a67b370f-1dd2-41d0-939a-b0faddc2c3cc', 'a0e793f7-00a1-4601-bba6-1993cbd85417', 'f4aacd7e-f0c9-43e8-bd8a-2087a7043ca8'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:47:17 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Delete snapshot completed successfully. Sep 17 07:47:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-c453eaa9-5646-4950-aee5-2e1a47caf0ab-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Snapshots deleted, issuing volume delete {{(pid=83207) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 07:47:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-quobyte-d455fdbc-6e3e-4f0b-9016-259278bb119c" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-d455fdbc-6e3e-4f0b-9016-259278bb119c" acquired by "delete_volume" :: waited 0.017s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:18 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e6c5f7-1c14-4831-90b9-b5286245963d]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c" returned: 0 in 0.446s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d455fdbc-6e3e-4f0b-9016-259278bb119c" returned: 0 in 0.113s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-d455fdbc-6e3e-4f0b-9016-259278bb119c" released by "delete_volume" :: held 0.772s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:19 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Created reservations ['f9c069da-60f9-453d-af06-a8cd8f86b8c7', 'd0d44505-dcbf-416c-878c-d83191425bb0', 'bfc8b639-8f37-4617-a7b9-325be8170ef1', '5f7af3ff-7bb1-4fe5-a334-6fc0ba6f18da'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:47:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:19 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:47:19 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:47:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.092s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:19 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:47:19 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Deleted volume successfully. Sep 17 07:47:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-75323572-7ef8-4e31-a4f8-ee72712eb912 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-d455fdbc-6e3e-4f0b-9016-259278bb119c-delete_volume" released by "delete_volume" :: held 7.991s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:20 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Flow 'volume_create_manager' (f48d5ec5-57b1-4615-b433-d576dcc32507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6450347-b8d6-4057-a881-2a5b4974cf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6450347-b8d6-4057-a881-2a5b4974cf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1947089143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6c406f-2908-4f15-81d6-9ed632fc233d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80206cf37b748c889048edadb2ce8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:47:20Z,use_quota=True,user_id='b48d4b128b8743519efed6d6cfe4a812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c675c3b9-bb91-4de2-8b2e-66f4924cdb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c675c3b9-bb91-4de2-8b2e-66f4924cdb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a940e94-30c1-4cff-b1bb-395a5c6f71ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a940e94-30c1-4cff-b1bb-395a5c6f71ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f6c406f-2908-4f15-81d6-9ed632fc233d', 'volume_name': 'volume-1f6c406f-2908-4f15-81d6-9ed632fc233d', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69928f04-4ed7-4406-ac9d-579039ec02c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69928f04-4ed7-4406-ac9d-579039ec02c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e7faf4-6207-425e-9c3d-b65c78388b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:20 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Volume 1f6c406f-2908-4f15-81d6-9ed632fc233d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f6c406f-2908-4f15-81d6-9ed632fc233d', 'volume_size': 1} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1947089143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6c406f-2908-4f15-81d6-9ed632fc233d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80206cf37b748c889048edadb2ce8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:47:20Z,use_quota=True,user_id='b48d4b128b8743519efed6d6cfe4a812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Creating volume 1f6c406f-2908-4f15-81d6-9ed632fc233d {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:47:20 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:20 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=70, name=volume-1f6c406f-2908-4f15-81d6-9ed632fc233d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d 1073741824" returned: 0 in 0.379s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d" returned: 0 in 0.100s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:21 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] <== create_volume: return (561ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:47:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.575s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e7faf4-6207-425e-9c3d-b65c78388b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f6c406f-2908-4f15-81d6-9ed632fc233d', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485ad48f-018b-476d-8650-4e52ec503d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:21 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Volume volume-1f6c406f-2908-4f15-81d6-9ed632fc233d (1f6c406f-2908-4f15-81d6-9ed632fc233d): created successfully Sep 17 07:47:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485ad48f-018b-476d-8650-4e52ec503d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Flow 'volume_create_manager' (f48d5ec5-57b1-4615-b433-d576dcc32507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:47:21 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-bd8e3b1e-0d48-423b-95e8-e26a34a5a193 tempest-VolumesDeleteCascade-584087184 None] Created volume successfully. Sep 17 07:47:22 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] Creating offline snapshot d081d4b8-9338-41dd-8f06-442555ad99d6 of volume 1f6c406f-2908-4f15-81d6-9ed632fc233d {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:47:22 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[38667ce2-360e-408e-b4c2-6d943b54e705]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d" returned: 0 in 0.499s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:23 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=71, name=volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:47:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6 1G" returned: 0 in 0.273s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1f6c406f-2908-4f15-81d6-9ed632fc233d -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] CMD "qemu-img rebase -u -b volume-1f6c406f-2908-4f15-81d6-9ed632fc233d -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6" returned: 0 in 0.209s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:47:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6" returned: 0 in 0.095s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:47:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6" returned: 0 in 0.091s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.info" returned: 0 in 0.097s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:47:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.info" returned: 0 in 0.092s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.781s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:24 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ebcdda0f-5ddc-49d9-aaec-538daa865f4e tempest-VolumesDeleteCascade-584087184 None] Create snapshot completed successfully Sep 17 07:47:26 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Flow 'volume_create_manager' (b9bdf307-25d6-43f3-a178-a86b0f83f3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eeb71f2-baf5-4ffe-b86c-b04c4ba6084d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eeb71f2-baf5-4ffe-b86c-b04c4ba6084d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-861894736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd05269-2bba-4631-b92a-d4c8f8c02aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b80206cf37b748c889048edadb2ce8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d081d4b8-9338-41dd-8f06-442555ad99d6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:47:26Z,use_quota=True,user_id='b48d4b128b8743519efed6d6cfe4a812',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b571fe-84e0-4408-8579-979fb4724186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80b571fe-84e0-4408-8579-979fb4724186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d18a19-6200-4bb9-b24c-bf2c27d47096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d18a19-6200-4bb9-b24c-bf2c27d47096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3dd05269-2bba-4631-b92a-d4c8f8c02aca', 'volume_name': 'volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca', 'volume_size': 1, 'snapshot_id': 'd081d4b8-9338-41dd-8f06-442555ad99d6'}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced33799-5287-41c4-8ba8-3b634f434774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced33799-5287-41c4-8ba8-3b634f434774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1314f4e5-5e79-4d60-a2e2-dbfadea62f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:26 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Volume 3dd05269-2bba-4631-b92a-d4c8f8c02aca: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca', 'volume_size': 1, 'snapshot_id': 'd081d4b8-9338-41dd-8f06-442555ad99d6'} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-quobyte-d081d4b8-9338-41dd-8f06-442555ad99d6-3dd05269-2bba-4631-b92a-d4c8f8c02aca" by "_create_volume_from_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-d081d4b8-9338-41dd-8f06-442555ad99d6-3dd05269-2bba-4631-b92a-d4c8f8c02aca" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Creating volume 3dd05269-2bba-4631-b92a-d4c8f8c02aca from snapshot d081d4b8-9338-41dd-8f06-442555ad99d6 {{(pid=83207) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-quobyte-3dd05269-2bba-4631-b92a-d4c8f8c02aca" by "_copy_volume_from_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-3dd05269-2bba-4631-b92a-d4c8f8c02aca" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] snapshot: d081d4b8-9338-41dd-8f06-442555ad99d6, volume: 3dd05269-2bba-4631-b92a-d4c8f8c02aca, {{(pid=83207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:47:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[667671c3-4dca-45f2-bee6-0c431d457c01]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:27 devstack quobyte-client[83219]: System call of process 95026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:47:27 devstack quobyte-client[83219]: System call of process 95026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6" returned: 0 in 0.439s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f6c406f-2908-4f15-81d6-9ed632fc233d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] will copy from snapshot at /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d {{(pid=83207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Creating direct copy from snapshot {{(pid=83207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2f31dc-8066-4eee-ac75-df533f33ae0b]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.127s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:47:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d" returned: 0 in 0.546s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:28 devstack cinder-volume[83207]: DEBUG cinder.utils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca not found in is_blk_device check {{(pid=83207) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 17 07:47:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:28 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=73, name=volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:47:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca" returned: 0 in 6.883s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:35 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[022cc25c-2fa2-42da-8ab8-f5f73d96924c]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d" returned: 0 in 0.691s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:35 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Image conversion details: src /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d, size 1024.00 MB, duration 6.91 sec, destination /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca {{(pid=83207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 07:47:35 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Converted 1024.00 MB image at 148.26 MB/s Sep 17 07:47:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:47:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca" returned: 0 in 0.101s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-3dd05269-2bba-4631-b92a-d4c8f8c02aca" released by "_copy_volume_from_snapshot" :: held 9.099s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-d081d4b8-9338-41dd-8f06-442555ad99d6-3dd05269-2bba-4631-b92a-d4c8f8c02aca" released by "_create_volume_from_snapshot" :: held 9.142s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.163s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1314f4e5-5e79-4d60-a2e2-dbfadea62f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca', 'volume_size': 1, 'snapshot_id': 'd081d4b8-9338-41dd-8f06-442555ad99d6'}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be1279a-a749-4d30-a5b3-352a950c064c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:36 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Volume volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca (3dd05269-2bba-4631-b92a-d4c8f8c02aca): created successfully Sep 17 07:47:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be1279a-a749-4d30-a5b3-352a950c064c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Flow 'volume_create_manager' (b9bdf307-25d6-43f3-a178-a86b0f83f3c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:47:36 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-11f52591-c6ec-4aa1-9ca4-4c5cc7a1d70f tempest-VolumesDeleteCascade-584087184 None] Created volume successfully. Sep 17 07:47:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-1f6c406f-2908-4f15-81d6-9ed632fc233d-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-1f6c406f-2908-4f15-81d6-9ed632fc233d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:36 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Performing cascade delete. {{(pid=83207) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 07:47:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-d081d4b8-9338-41dd-8f06-442555ad99d6-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-d081d4b8-9338-41dd-8f06-442555ad99d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:36 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:37 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-quobyte-1f6c406f-2908-4f15-81d6-9ed632fc233d" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:37 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-1f6c406f-2908-4f15-81d6-9ed632fc233d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:37 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-quobyte-d081d4b8-9338-41dd-8f06-442555ad99d6" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:37 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-d081d4b8-9338-41dd-8f06-442555ad99d6" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Deleting offline snapshot d081d4b8-9338-41dd-8f06-442555ad99d6 of volume 1f6c406f-2908-4f15-81d6-9ed632fc233d {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:47:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] snapshot_file for this snap is: volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:47:37 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[55815b64-944b-4bf5-9831-34fba36837b3]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6" returned: 0 in 0.453s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f6c406f-2908-4f15-81d6-9ed632fc233d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:47:37 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e953cb50-afec-4b3c-8e0d-1e6b4767c28c]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d" returned: 0 in 0.435s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6" returned: 0 in 0.246s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d.d081d4b8-9338-41dd-8f06-442555ad99d6" returned: 0 in 0.127s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:38 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-d081d4b8-9338-41dd-8f06-442555ad99d6" released by "_delete_snapshot" :: held 1.572s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:38 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-1f6c406f-2908-4f15-81d6-9ed632fc233d" released by "delete_snapshot" :: held 1.593s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:38 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Created reservations ['0dbcffef-2aaa-4d73-8189-9ae989182b38', 'cb12ff2c-c20e-4673-932e-7e2e93b72bd6', 'fd46ad68-3c05-46e2-813d-9c00388ba73c', '516a855d-3ffb-4556-8af4-7ca4b80d0d54'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:47:39 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Delete snapshot completed successfully. Sep 17 07:47:39 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-d081d4b8-9338-41dd-8f06-442555ad99d6-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Snapshots deleted, issuing volume delete {{(pid=83207) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 07:47:39 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-quobyte-1f6c406f-2908-4f15-81d6-9ed632fc233d" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:39 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-1f6c406f-2908-4f15-81d6-9ed632fc233d" acquired by "delete_volume" :: waited 0.018s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:39 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8900cbc-4f3a-4df4-bfdc-5c93f3a4a4c4]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d" returned: 0 in 0.443s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1f6c406f-2908-4f15-81d6-9ed632fc233d" returned: 0 in 0.093s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:39 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-1f6c406f-2908-4f15-81d6-9ed632fc233d" released by "delete_volume" :: held 0.722s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:40 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Created reservations ['20b8dd97-def6-4976-869b-5aab2ec9a7f9', 'e4ec38f2-e9a1-4d32-9864-f85705da4308', '562bf478-ad84-4e5e-bfbf-4ae42a9344e6', '9327b6bf-ad5d-41e3-8c10-196c43eb8cf2'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:47:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:47:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:47:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.096s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:40 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:47:40 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Deleted volume successfully. Sep 17 07:47:40 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1761fcaf-230c-49c9-93ea-257d4458d5ae tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-1f6c406f-2908-4f15-81d6-9ed632fc233d-delete_volume" released by "delete_volume" :: held 3.897s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:41 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-3dd05269-2bba-4631-b92a-d4c8f8c02aca-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:41 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-3dd05269-2bba-4631-b92a-d4c8f8c02aca-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:41 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:41 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "cinder-quobyte-3dd05269-2bba-4631-b92a-d4c8f8c02aca" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:41 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-3dd05269-2bba-4631-b92a-d4c8f8c02aca" acquired by "delete_volume" :: waited 0.016s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:41 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9173f4f9-2da1-41f6-b29a-de3484ddfed0]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca" returned: 0 in 0.460s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3dd05269-2bba-4631-b92a-d4c8f8c02aca" returned: 0 in 0.095s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:42 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-quobyte-3dd05269-2bba-4631-b92a-d4c8f8c02aca" released by "delete_volume" :: held 0.733s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:42 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Created reservations ['494f10f5-bce8-4d9c-8fc4-9749bfa728db', '92c8f740-d747-4c84-a91d-46a1dfbadf64', '42c81bb1-2f25-4910-bf27-bf08a02e89a0', 'dd484e5a-f248-4af4-997a-f7a49b6257dd'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:47:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:47:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:47:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.105s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:43 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:47:43 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Deleted volume successfully. Sep 17 07:47:43 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-56fc6b37-858b-4aca-bbd3-bccb88139d85 tempest-VolumesDeleteCascade-584087184 None] Lock "cinder-3dd05269-2bba-4631-b92a-d4c8f8c02aca-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:47 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=42,cinder:UPDATE=54,cinder:DELETE=6,cinder:INSERT=14 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:47:48 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Flow 'volume_create_manager' (206e8fab-730c-4e9f-bb7c-86fb0e88f7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f368c8-fcfa-4882-9aaf-870a96f56ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f368c8-fcfa-4882-9aaf-870a96f56ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2111651525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8431d5f-3ac1-4be8-8ad3-142fd532d09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93a3a7f8c334f3faf35f873f25be7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:47:48Z,use_quota=True,user_id='0712b553c7694e6f9035b3c41cae1b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd963bb-4166-4dd1-9c73-9facde073953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd963bb-4166-4dd1-9c73-9facde073953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa04f9e-98f0-4e62-8381-fedd9039b607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa04f9e-98f0-4e62-8381-fedd9039b607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8431d5f-3ac1-4be8-8ad3-142fd532d09e', 'volume_name': 'volume-a8431d5f-3ac1-4be8-8ad3-142fd532d09e', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66e20b2-d25f-4df0-8fcc-62797380d293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66e20b2-d25f-4df0-8fcc-62797380d293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b2cdbb-3897-4b28-975c-3555c7d723c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:48 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Volume a8431d5f-3ac1-4be8-8ad3-142fd532d09e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8431d5f-3ac1-4be8-8ad3-142fd532d09e', 'volume_size': 1} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2111651525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8431d5f-3ac1-4be8-8ad3-142fd532d09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93a3a7f8c334f3faf35f873f25be7f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:47:48Z,use_quota=True,user_id='0712b553c7694e6f9035b3c41cae1b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Creating volume a8431d5f-3ac1-4be8-8ad3-142fd532d09e {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:47:48 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a8431d5f-3ac1-4be8-8ad3-142fd532d09e 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:48 devstack quobyte-client[83219]: System call of process 95092 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:47:48 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=74, name=volume-a8431d5f-3ac1-4be8-8ad3-142fd532d09e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a8431d5f-3ac1-4be8-8ad3-142fd532d09e 1073741824" returned: 0 in 0.434s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a8431d5f-3ac1-4be8-8ad3-142fd532d09e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a8431d5f-3ac1-4be8-8ad3-142fd532d09e" returned: 0 in 0.126s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] <== create_volume: return (662ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:47:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b2cdbb-3897-4b28-975c-3555c7d723c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8431d5f-3ac1-4be8-8ad3-142fd532d09e', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be06423f-c9b6-4203-a741-755149a16431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:49 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=67,cinder:SELECT=51,cinder:DELETE=5,cinder:INSERT=14 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:47:49 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Volume volume-a8431d5f-3ac1-4be8-8ad3-142fd532d09e (a8431d5f-3ac1-4be8-8ad3-142fd532d09e): created successfully Sep 17 07:47:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be06423f-c9b6-4203-a741-755149a16431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Flow 'volume_create_manager' (206e8fab-730c-4e9f-bb7c-86fb0e88f7aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:47:49 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ef545597-cb95-4a97-b0f5-b12f8ea6d378 tempest-VolumesMetadataTest-1376734843 None] Created volume successfully. Sep 17 07:47:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Acquiring lock "cinder-a8431d5f-3ac1-4be8-8ad3-142fd532d09e-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Lock "cinder-a8431d5f-3ac1-4be8-8ad3-142fd532d09e-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:51 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Acquiring lock "cinder-quobyte-a8431d5f-3ac1-4be8-8ad3-142fd532d09e" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:47:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Lock "cinder-quobyte-a8431d5f-3ac1-4be8-8ad3-142fd532d09e" acquired by "delete_volume" :: waited 0.017s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:47:51 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5dd727-00fd-4507-96f7-d9461b9f8648]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:47:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a8431d5f-3ac1-4be8-8ad3-142fd532d09e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a8431d5f-3ac1-4be8-8ad3-142fd532d09e" returned: 0 in 0.501s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a8431d5f-3ac1-4be8-8ad3-142fd532d09e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a8431d5f-3ac1-4be8-8ad3-142fd532d09e" returned: 0 in 0.096s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Lock "cinder-quobyte-a8431d5f-3ac1-4be8-8ad3-142fd532d09e" released by "delete_volume" :: held 0.801s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:52 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Created reservations ['35de3b20-836f-4b8f-aca8-6eb999b34dd2', '0688da21-b830-4283-bc13-dee74cf6b10c', '2f97dc38-1e20-49d6-abb1-5c034317cddf', '204902cd-b2ee-4967-83b9-7c6b9563b5db'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:47:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:47:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:47:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.118s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:52 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:47:52 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Deleted volume successfully. Sep 17 07:47:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-49f7a9d2-621e-4167-9bba-76b128f56c13 tempest-VolumesMetadataTest-1376734843 None] Lock "cinder-a8431d5f-3ac1-4be8-8ad3-142fd532d09e-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:47:58 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Flow 'volume_create_manager' (d33a276c-2e3a-47db-ba96-3ffea0214a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5281a4-e043-4470-957a-c05d99a91373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5281a4-e043-4470-957a-c05d99a91373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-291472296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79e78ee-1f35-4969-b676-1cdb01061c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90cbda7ac96f4e04a413422c1dd9a115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:47:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:47:58Z,use_quota=True,user_id='e1dabf86320b422aa5f4044a3810f18c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa91e71-ee08-4bb6-8387-a656b8c1a17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa91e71-ee08-4bb6-8387-a656b8c1a17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ef9968-022f-4b60-8ec2-06eaa6189eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ef9968-022f-4b60-8ec2-06eaa6189eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a79e78ee-1f35-4969-b676-1cdb01061c0c', 'volume_name': 'volume-a79e78ee-1f35-4969-b676-1cdb01061c0c', 'volume_size': 2}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca793ec8-45e3-4419-a67d-c0b5ff1538c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca793ec8-45e3-4419-a67d-c0b5ff1538c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786c40fd-1fc5-4a47-8db2-7c91bfd03bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:58 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Volume a79e78ee-1f35-4969-b676-1cdb01061c0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a79e78ee-1f35-4969-b676-1cdb01061c0c', 'volume_size': 2} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-291472296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79e78ee-1f35-4969-b676-1cdb01061c0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90cbda7ac96f4e04a413422c1dd9a115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:47:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:47:58Z,use_quota=True,user_id='e1dabf86320b422aa5f4044a3810f18c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Creating volume a79e78ee-1f35-4969-b676-1cdb01061c0c {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:47:58 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:47:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a79e78ee-1f35-4969-b676-1cdb01061c0c 2147483648 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:58 devstack quobyte-client[83219]: System call of process 95140 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:47:58 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=75, name=volume-a79e78ee-1f35-4969-b676-1cdb01061c0c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:47:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a79e78ee-1f35-4969-b676-1cdb01061c0c 2147483648" returned: 0 in 0.589s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a79e78ee-1f35-4969-b676-1cdb01061c0c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:47:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a79e78ee-1f35-4969-b676-1cdb01061c0c" returned: 0 in 0.096s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:47:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] <== create_volume: return (762ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:47:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:47:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786c40fd-1fc5-4a47-8db2-7c91bfd03bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a79e78ee-1f35-4969-b676-1cdb01061c0c', 'volume_size': 2}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e98269-11da-4b78-9fbf-135f4f7c66ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:47:59 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Volume volume-a79e78ee-1f35-4969-b676-1cdb01061c0c (a79e78ee-1f35-4969-b676-1cdb01061c0c): created successfully Sep 17 07:47:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04e98269-11da-4b78-9fbf-135f4f7c66ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:47:59 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Flow 'volume_create_manager' (d33a276c-2e3a-47db-ba96-3ffea0214a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:47:59 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-cb54b5e8-ed2e-4d9d-83a5-f78f96665b4b tempest-VolumesCloneNegativeTest-39521666 None] Created volume successfully. Sep 17 07:48:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Acquiring lock "cinder-a79e78ee-1f35-4969-b676-1cdb01061c0c-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:48:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Lock "cinder-a79e78ee-1f35-4969-b676-1cdb01061c0c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:48:01 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Acquiring lock "cinder-quobyte-a79e78ee-1f35-4969-b676-1cdb01061c0c" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:48:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Lock "cinder-quobyte-a79e78ee-1f35-4969-b676-1cdb01061c0c" acquired by "delete_volume" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:48:01 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c24543-6d56-4c0c-a9c9-e51746f92ab2]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:48:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a79e78ee-1f35-4969-b676-1cdb01061c0c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a79e78ee-1f35-4969-b676-1cdb01061c0c" returned: 0 in 0.730s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a79e78ee-1f35-4969-b676-1cdb01061c0c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a79e78ee-1f35-4969-b676-1cdb01061c0c" returned: 0 in 0.233s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:02 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Lock "cinder-quobyte-a79e78ee-1f35-4969-b676-1cdb01061c0c" released by "delete_volume" :: held 1.171s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:48:02 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Created reservations ['a51e8d26-04ad-47d8-8416-bdb93f97524e', '6b46330c-c6e9-43e6-ae56-266b1fcbb8df', 'b3734c86-4a75-4e13-97e4-5064b1e7408e', 'fb88dbbd-e3bd-43a6-b842-248b9d443e21'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:48:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:48:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:48:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.140s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:03 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:48:03 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Deleted volume successfully. Sep 17 07:48:03 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7f2b021d-a531-4905-acb9-575a00b2b49d tempest-VolumesCloneNegativeTest-39521666 None] Lock "cinder-a79e78ee-1f35-4969-b676-1cdb01061c0c-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:48:08 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:08 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:48:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Flow 'volume_create_manager' (606c3a4a-5994-4590-8e9a-e6e62cad049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:48:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19495c8-2e6d-4bf6-8397-e007ff494681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19495c8-2e6d-4bf6-8397-e007ff494681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-452510533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19745f7-7798-472e-a377-15e825ff370a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd8ab7aa2c9f44b7b7efc89e46cd5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:48:08Z,use_quota=True,user_id='361346d4b3f44cbda908b433740bca94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d9a0a1-50ba-4f9a-9ea1-7a9b49877469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d9a0a1-50ba-4f9a-9ea1-7a9b49877469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a48a77-9234-4e3d-9171-780dcd060860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a48a77-9234-4e3d-9171-780dcd060860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f19745f7-7798-472e-a377-15e825ff370a', 'volume_name': 'volume-f19745f7-7798-472e-a377-15e825ff370a', 'volume_size': 1, 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91606166160a47f193bac06562c1b40d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c23af952-419c-402d-9c13-65fae52513d0', 'created_at': datetime.datetime(2025, 9, 17, 5, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23af952-419c-402d-9c13-65fae52513d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8bb2c6f-f431-496e-9ab3-8163dcd78e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8bb2c6f-f431-496e-9ab3-8163dcd78e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65540d87-21d1-4c00-a468-012fd80743f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:08 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Volume f19745f7-7798-472e-a377-15e825ff370a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f19745f7-7798-472e-a377-15e825ff370a', 'volume_size': 1, 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91606166160a47f193bac06562c1b40d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c23af952-419c-402d-9c13-65fae52513d0', 'created_at': datetime.datetime(2025, 9, 17, 5, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23af952-419c-402d-9c13-65fae52513d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 07:48:08 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Cloning f19745f7-7798-472e-a377-15e825ff370a from image c23af952-419c-402d-9c13-65fae52513d0 at location (None, None). {{(pid=83207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}} Sep 17 07:48:08 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_l7gb0h4ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 17 07:48:08 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Image download 20.69 MB at 20.69 MB/s Sep 17 07:48:08 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8824cd-ad23-4e13-bf79-5eeb4b12280a]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:48:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_l7gb0h4ndevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:09 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_l7gb0h4ndevstack@QuobyteHD Sep 17 07:48:09 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:48:11 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Sep 17 07:48:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_l7gb0h4ndevstack@QuobyteHD" returned: 0 in 2.237s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:11 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Temporary image c23af952-419c-402d-9c13-65fae52513d0 is fetched for user 361346d4b3f44cbda908b433740bca94. {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 17 07:48:11 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f89b464-8729-4d51-b947-25f94c737130]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:48:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_l7gb0h4ndevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:11 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_l7gb0h4ndevstack@QuobyteHD Sep 17 07:48:11 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:48:13 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 17 07:48:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_l7gb0h4ndevstack@QuobyteHD" returned: 0 in 2.216s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-452510533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19745f7-7798-472e-a377-15e825ff370a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd8ab7aa2c9f44b7b7efc89e46cd5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:48:08Z,use_quota=True,user_id='361346d4b3f44cbda908b433740bca94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:48:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Creating volume f19745f7-7798-472e-a377-15e825ff370a {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:48:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:48:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:48:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:48:13 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:48:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:13 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=76, name=volume-f19745f7-7798-472e-a377-15e825ff370a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:48:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a 1073741824" returned: 0 in 0.322s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a" returned: 0 in 0.091s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] <== create_volume: return (513ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:48:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.547s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:14 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Attempting download of c23af952-419c-402d-9c13-65fae52513d0 ((None, None)) to volume f19745f7-7798-472e-a377-15e825ff370a. {{(pid=83207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 17 07:48:14 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef8a5c4-f59c-47f1-a397-86acd0623212]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:48:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_vl8m2xxc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_vl8m2xxc" returned: 0 in 0.371s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_vl8m2xxc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_vl8m2xxc" returned: 1 in 0.354s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_vl8m2xxc' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:48:15 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[096b52bf-7427-4c90-a0a5-97f9d802daac]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:48:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_l7gb0h4ndevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_l7gb0h4ndevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:15 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] c23af952-419c-402d-9c13-65fae52513d0 was qcow2, converting to raw {{(pid=83207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 17 07:48:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_l7gb0h4ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:16 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=76, name=volume-f19745f7-7798-472e-a377-15e825ff370a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:48:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_l7gb0h4ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a" returned: 0 in 0.999s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:16 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_l7gb0h4ndevstack@QuobyteHD, size 112.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a {{(pid=83207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 07:48:16 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Converted 112.00 MB image at 109.09 MB/s Sep 17 07:48:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a 1G" returned: 0 in 0.132s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:17 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2cc661-6478-45a2-86a5-0593a20e54f5]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:48:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a" returned: 0 in 0.366s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a" returned: 1 in 0.354s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:48:18 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Downloaded image c23af952-419c-402d-9c13-65fae52513d0 ((None, None)) to volume f19745f7-7798-472e-a377-15e825ff370a successfully. {{(pid=83207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 17 07:48:18 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Temporary image c23af952-419c-402d-9c13-65fae52513d0 for user 361346d4b3f44cbda908b433740bca94 is deleted. {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 17 07:48:18 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Marking volume f19745f7-7798-472e-a377-15e825ff370a as bootable. {{(pid=83207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 17 07:48:18 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Copying metadata from image c23af952-419c-402d-9c13-65fae52513d0 to f19745f7-7798-472e-a377-15e825ff370a. {{(pid=83207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 07:48:18 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Creating volume glance metadata for volume f19745f7-7798-472e-a377-15e825ff370a backed by image c23af952-419c-402d-9c13-65fae52513d0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 07:48:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65540d87-21d1-4c00-a468-012fd80743f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f19745f7-7798-472e-a377-15e825ff370a', 'volume_size': 1, 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91606166160a47f193bac06562c1b40d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c23af952-419c-402d-9c13-65fae52513d0', 'created_at': datetime.datetime(2025, 9, 17, 5, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23af952-419c-402d-9c13-65fae52513d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5bbad96-bb65-4a1e-bf27-70328b3ace60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:18 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Volume volume-f19745f7-7798-472e-a377-15e825ff370a (f19745f7-7798-472e-a377-15e825ff370a): created successfully Sep 17 07:48:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5bbad96-bb65-4a1e-bf27-70328b3ace60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Flow 'volume_create_manager' (606c3a4a-5994-4590-8e9a-e6e62cad049c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:48:18 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-3711f515-e363-4a11-8d47-0db5fa089ef8 tempest-VolumesExtendTest-232328969 None] Created volume successfully. Sep 17 07:48:18 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-3b80a2bc-0fa9-4f65-8620-5a269e82e162 tempest-VolumesExtendTest-232328969 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3b80a2bc-0fa9-4f65-8620-5a269e82e162 tempest-VolumesExtendTest-232328969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3b80a2bc-0fa9-4f65-8620-5a269e82e162 tempest-VolumesExtendTest-232328969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:19 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2276932-a22c-4835-87c5-f4180d54e51d]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:48:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3b80a2bc-0fa9-4f65-8620-5a269e82e162 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3b80a2bc-0fa9-4f65-8620-5a269e82e162 tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a" returned: 0 in 0.420s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3b80a2bc-0fa9-4f65-8620-5a269e82e162 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3b80a2bc-0fa9-4f65-8620-5a269e82e162 tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a" returned: 1 in 0.367s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3b80a2bc-0fa9-4f65-8620-5a269e82e162 tempest-VolumesExtendTest-232328969 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:48:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3b80a2bc-0fa9-4f65-8620-5a269e82e162 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a 2G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:19 devstack quobyte-client[83219]: System call of process 95240 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:48:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3b80a2bc-0fa9-4f65-8620-5a269e82e162 tempest-VolumesExtendTest-232328969 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a 2G" returned: 0 in 0.143s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3b80a2bc-0fa9-4f65-8620-5a269e82e162 tempest-VolumesExtendTest-232328969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.094s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:20 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-3b80a2bc-0fa9-4f65-8620-5a269e82e162 tempest-VolumesExtendTest-232328969 None] Extend volume completed successfully. Sep 17 07:48:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Acquiring lock "cinder-f19745f7-7798-472e-a377-15e825ff370a-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:48:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Lock "cinder-f19745f7-7798-472e-a377-15e825ff370a-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:48:21 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Acquiring lock "cinder-quobyte-f19745f7-7798-472e-a377-15e825ff370a" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:48:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Lock "cinder-quobyte-f19745f7-7798-472e-a377-15e825ff370a" acquired by "delete_volume" :: waited 0.015s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:48:21 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8e1bcc-eaa2-448c-9adf-79310c9a6087]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:48:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a" returned: 0 in 0.382s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a" returned: 1 in 0.369s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:48:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-f19745f7-7798-472e-a377-15e825ff370a" returned: 0 in 0.086s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Lock "cinder-quobyte-f19745f7-7798-472e-a377-15e825ff370a" released by "delete_volume" :: held 1.112s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:48:22 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Created reservations ['b9aec52f-0f15-4197-8023-04a7ad63b504', '30e31864-f045-4aec-b051-e1c6f288ac69', 'f7251be3-6a4b-4149-8250-e324d8cb6809', '01f71200-7daf-423f-afbe-b6b2cf212305'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:48:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:48:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:48:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.084s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:23 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:48:23 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Deleted volume successfully. Sep 17 07:48:23 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6d370eb2-fd2b-4335-b7b5-285a3ee65e4a tempest-VolumesExtendTest-232328969 None] Lock "cinder-f19745f7-7798-472e-a377-15e825ff370a-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:48:24 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Flow 'volume_create_manager' (f43a2efb-8696-4a1e-8386-bc2fa3dfacdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12d9db4-eace-4b87-bfe5-fdafe1d4c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12d9db4-eace-4b87-bfe5-fdafe1d4c473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-209351531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a201be28-f834-4cab-985b-e36cc30bc06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd8ab7aa2c9f44b7b7efc89e46cd5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:48:24Z,use_quota=True,user_id='361346d4b3f44cbda908b433740bca94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0417cfd-13e6-4c5f-9186-b8bbcf615f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0417cfd-13e6-4c5f-9186-b8bbcf615f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb404190-83b0-40f6-80a0-9545076cbb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb404190-83b0-40f6-80a0-9545076cbb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a201be28-f834-4cab-985b-e36cc30bc06e', 'volume_name': 'volume-a201be28-f834-4cab-985b-e36cc30bc06e', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b014f5-5513-47ec-9f70-160c1775d584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b014f5-5513-47ec-9f70-160c1775d584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8e8b69-d083-4626-9e29-9ba45f95b584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:24 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Volume a201be28-f834-4cab-985b-e36cc30bc06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a201be28-f834-4cab-985b-e36cc30bc06e', 'volume_size': 1} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-209351531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a201be28-f834-4cab-985b-e36cc30bc06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd8ab7aa2c9f44b7b7efc89e46cd5f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:48:24Z,use_quota=True,user_id='361346d4b3f44cbda908b433740bca94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Creating volume a201be28-f834-4cab-985b-e36cc30bc06e {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:48:24 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:24 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=77, name=volume-a201be28-f834-4cab-985b-e36cc30bc06e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e 1073741824" returned: 0 in 0.366s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e" returned: 0 in 0.083s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] <== create_volume: return (512ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:48:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.523s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b8e8b69-d083-4626-9e29-9ba45f95b584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a201be28-f834-4cab-985b-e36cc30bc06e', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebc79b5-f09c-41cb-b63b-9c3ae574cae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:25 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Volume volume-a201be28-f834-4cab-985b-e36cc30bc06e (a201be28-f834-4cab-985b-e36cc30bc06e): created successfully Sep 17 07:48:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebc79b5-f09c-41cb-b63b-9c3ae574cae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Flow 'volume_create_manager' (f43a2efb-8696-4a1e-8386-bc2fa3dfacdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:48:25 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-db7fe7bd-74ea-477b-9a6e-d83752be3797 tempest-VolumesExtendTest-232328969 None] Created volume successfully. Sep 17 07:48:26 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] Creating offline snapshot f9edd054-14cd-4288-a014-ac9fee6a4487 of volume a201be28-f834-4cab-985b-e36cc30bc06e {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:48:26 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7eb17a-b385-4764-a54b-d4fa522ea4e7]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:48:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e" returned: 0 in 0.459s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:27 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=78, name=volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487 1G" returned: 0 in 0.269s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a201be28-f834-4cab-985b-e36cc30bc06e -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] CMD "qemu-img rebase -u -b volume-a201be28-f834-4cab-985b-e36cc30bc06e -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487" returned: 0 in 0.129s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487" returned: 0 in 0.075s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487" returned: 0 in 0.227s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.171s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:48:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.info" returned: 0 in 0.165s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:48:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.info" returned: 0 in 0.077s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.726s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:28 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4a1c1dd6-486d-416f-8865-1fbc62afd479 tempest-VolumesExtendTest-232328969 None] Create snapshot completed successfully Sep 17 07:48:28 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-9bf85f41-4098-4499-ad53-9b56a7896017 tempest-VolumesExtendTest-232328969 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9bf85f41-4098-4499-ad53-9b56a7896017 tempest-VolumesExtendTest-232328969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9bf85f41-4098-4499-ad53-9b56a7896017 tempest-VolumesExtendTest-232328969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:28 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32c3159-52c2-4332-9865-3761ad4106ae]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:48:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9bf85f41-4098-4499-ad53-9b56a7896017 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9bf85f41-4098-4499-ad53-9b56a7896017 tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e" returned: 0 in 0.467s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9bf85f41-4098-4499-ad53-9b56a7896017 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487 2G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:29 devstack quobyte-client[83219]: System call of process 95273 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:48:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9bf85f41-4098-4499-ad53-9b56a7896017 tempest-VolumesExtendTest-232328969 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487 2G" returned: 0 in 0.181s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9bf85f41-4098-4499-ad53-9b56a7896017 tempest-VolumesExtendTest-232328969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.751s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:29 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-9bf85f41-4098-4499-ad53-9b56a7896017 tempest-VolumesExtendTest-232328969 None] Extend volume completed successfully. Sep 17 07:48:30 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-ebdb69e5-7752-4fa6-a96b-99d84d1b6053 req-daf95971-82cc-48a3-947d-8f6fcbb9e47c tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:30 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-ebdb69e5-7752-4fa6-a96b-99d84d1b6053 req-daf95971-82cc-48a3-947d-8f6fcbb9e47c tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:30 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-ebdb69e5-7752-4fa6-a96b-99d84d1b6053 req-daf95971-82cc-48a3-947d-8f6fcbb9e47c tempest-AttachVolumeNegativeTest-1634306197 None] Terminate volume connection completed successfully. Sep 17 07:48:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-ebdb69e5-7752-4fa6-a96b-99d84d1b6053 req-daf95971-82cc-48a3-947d-8f6fcbb9e47c tempest-AttachVolumeNegativeTest-1634306197 None] Deleting attachment 4eeb0eb7-df5c-4b17-9d83-9364ec0ba96a. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:48:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Acquiring lock "cinder-f9edd054-14cd-4288-a014-ac9fee6a4487-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:48:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Lock "cinder-f9edd054-14cd-4288-a014-ac9fee6a4487-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:48:31 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Acquiring lock "cinder-quobyte-a201be28-f834-4cab-985b-e36cc30bc06e" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:48:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Lock "cinder-quobyte-a201be28-f834-4cab-985b-e36cc30bc06e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:48:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Acquiring lock "cinder-quobyte-f9edd054-14cd-4288-a014-ac9fee6a4487" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:48:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Lock "cinder-quobyte-f9edd054-14cd-4288-a014-ac9fee6a4487" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:48:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Deleting offline snapshot f9edd054-14cd-4288-a014-ac9fee6a4487 of volume a201be28-f834-4cab-985b-e36cc30bc06e {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:48:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] snapshot_file for this snap is: volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:48:31 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[27be643e-7795-4b5a-9819-2244fb06b7c5]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:48:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487" returned: 0 in 0.397s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a201be28-f834-4cab-985b-e36cc30bc06e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:48:31 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6086c822-5178-41c8-b4dd-2b753208758f]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:48:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e" returned: 0 in 0.402s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:32 devstack quobyte-client[83219]: System call of process 95285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:48:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487" returned: 0 in 0.301s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e.f9edd054-14cd-4288-a014-ac9fee6a4487" returned: 0 in 0.125s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Lock "cinder-quobyte-f9edd054-14cd-4288-a014-ac9fee6a4487" released by "_delete_snapshot" :: held 1.525s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:48:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Lock "cinder-quobyte-a201be28-f834-4cab-985b-e36cc30bc06e" released by "delete_snapshot" :: held 1.553s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:48:33 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Created reservations ['01d8c60e-ea2d-4489-8522-1bf231e912c7', '867339ec-4e3e-4327-809b-bdf3f5ff00e0', '5b5ef50b-4cdb-473c-8091-250dbb6430fe', 'b36f9c9e-0849-457b-9296-23a34f4bc8a1'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:48:33 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Delete snapshot completed successfully. Sep 17 07:48:33 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9f8a3a31-2ba5-4c5b-9fad-5a02a7cc3425 tempest-VolumesExtendTest-232328969 None] Lock "cinder-f9edd054-14cd-4288-a014-ac9fee6a4487-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:48:33 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Acquiring lock "cinder-a201be28-f834-4cab-985b-e36cc30bc06e-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:48:33 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Lock "cinder-a201be28-f834-4cab-985b-e36cc30bc06e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:48:33 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:33 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Acquiring lock "cinder-quobyte-a201be28-f834-4cab-985b-e36cc30bc06e" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:48:33 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Lock "cinder-quobyte-a201be28-f834-4cab-985b-e36cc30bc06e" acquired by "delete_volume" :: waited 0.014s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:48:33 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f67c67-8c17-4f21-92dc-6a1c0e26bd7c]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:48:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e" returned: 0 in 1.418s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a201be28-f834-4cab-985b-e36cc30bc06e" returned: 0 in 0.086s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:35 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Lock "cinder-quobyte-a201be28-f834-4cab-985b-e36cc30bc06e" released by "delete_volume" :: held 1.694s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:48:35 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Created reservations ['d142e951-ad64-4687-aa81-879eb88bc11f', '7001f399-459c-43a5-835b-12c6950159c5', '497a5d6b-da21-4e50-a215-e517c728d175', '7c60fc43-e462-47c3-b558-97d2e168b4da'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:48:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:48:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:48:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.105s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:36 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:48:36 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Deleted volume successfully. Sep 17 07:48:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6848acee-f6ad-46dc-9c51-2b834db1b38e tempest-VolumesExtendTest-232328969 None] Lock "cinder-a201be28-f834-4cab-985b-e36cc30bc06e-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:48:45 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Flow 'volume_create_manager' (2549c74f-4808-4cc9-a740-220ed60c4cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a98f9f-4d89-49fe-b69e-81b3599b8aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a98f9f-4d89-49fe-b69e-81b3599b8aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1611817622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4ddb51400c34a81b1dec79ce82cc9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:48:45Z,use_quota=True,user_id='21d339a97c2c458da1e0f4611af40481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b809991-bbc8-48d9-a378-a7abfa2a3b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b809991-bbc8-48d9-a378-a7abfa2a3b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef209a34-6a22-47ee-921c-278de0040f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef209a34-6a22-47ee-921c-278de0040f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9', 'volume_name': 'volume-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b35c658-e296-49f2-b791-11e4519b6ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b35c658-e296-49f2-b791-11e4519b6ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5aecc2-3732-42fe-a165-8c862d4583b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:45 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Volume 7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9', 'volume_size': 1} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1611817622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4ddb51400c34a81b1dec79ce82cc9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:48:45Z,use_quota=True,user_id='21d339a97c2c458da1e0f4611af40481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Creating volume 7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:48:45 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:48:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:45 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=80, name=volume-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:48:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9 1073741824" returned: 0 in 0.423s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9" returned: 0 in 0.100s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] <== create_volume: return (637ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:48:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.654s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5aecc2-3732-42fe-a165-8c862d4583b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f56be5-2266-4f34-8f87-08261d4e67bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:46 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Volume volume-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9 (7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9): created successfully Sep 17 07:48:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f56be5-2266-4f34-8f87-08261d4e67bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Flow 'volume_create_manager' (2549c74f-4808-4cc9-a740-220ed60c4cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:48:46 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-7205b0c6-5d57-4b46-b6ae-83208c4bd75e tempest-VolumesListTestJSON-1229592532 None] Created volume successfully. Sep 17 07:48:48 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Flow 'volume_create_manager' (aa9a01e5-1540-4f7c-8c9f-a068e35859dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cc8d26-ae4e-45cb-93bd-1f5c35393957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=38,cinder:UPDATE=65,cinder:DELETE=5,cinder:INSERT=12 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8cc8d26-ae4e-45cb-93bd-1f5c35393957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-985723598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357544d6-7b3f-4dd6-b908-a431a212e916,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4ddb51400c34a81b1dec79ce82cc9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:48:48Z,use_quota=True,user_id='21d339a97c2c458da1e0f4611af40481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12bed95c-fe74-4f48-abe5-2ddcbf273c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12bed95c-fe74-4f48-abe5-2ddcbf273c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35fd80ec-8b5a-4303-856b-b82661103b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35fd80ec-8b5a-4303-856b-b82661103b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '357544d6-7b3f-4dd6-b908-a431a212e916', 'volume_name': 'volume-357544d6-7b3f-4dd6-b908-a431a212e916', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd49e0b5-4824-414d-945e-d0323354ad0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd49e0b5-4824-414d-945e-d0323354ad0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62326650-eda8-4035-98bf-65acb50dcda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:48 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Volume 357544d6-7b3f-4dd6-b908-a431a212e916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-357544d6-7b3f-4dd6-b908-a431a212e916', 'volume_size': 1} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-985723598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357544d6-7b3f-4dd6-b908-a431a212e916,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4ddb51400c34a81b1dec79ce82cc9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:48:48Z,use_quota=True,user_id='21d339a97c2c458da1e0f4611af40481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Creating volume 357544d6-7b3f-4dd6-b908-a431a212e916 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:48:48 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-357544d6-7b3f-4dd6-b908-a431a212e916 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:48 devstack quobyte-client[83219]: System call of process 95350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:48:48 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=81, name=volume-357544d6-7b3f-4dd6-b908-a431a212e916, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-357544d6-7b3f-4dd6-b908-a431a212e916 1073741824" returned: 0 in 0.414s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-357544d6-7b3f-4dd6-b908-a431a212e916 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-357544d6-7b3f-4dd6-b908-a431a212e916" returned: 0 in 0.099s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] <== create_volume: return (596ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:48:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.611s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62326650-eda8-4035-98bf-65acb50dcda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-357544d6-7b3f-4dd6-b908-a431a212e916', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70d9e3b-f395-4beb-84f3-5b5b47ca9ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:49 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=49,cinder:UPDATE=47,cinder:INSERT=21,cinder:DELETE=5 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:48:49 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Volume volume-357544d6-7b3f-4dd6-b908-a431a212e916 (357544d6-7b3f-4dd6-b908-a431a212e916): created successfully Sep 17 07:48:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70d9e3b-f395-4beb-84f3-5b5b47ca9ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Flow 'volume_create_manager' (aa9a01e5-1540-4f7c-8c9f-a068e35859dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:48:49 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5c2d3aed-7273-48e3-873e-7fd84995ad91 tempest-VolumesListTestJSON-1229592532 None] Created volume successfully. Sep 17 07:48:50 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:50 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Flow 'volume_create_manager' (d40c2a64-c21b-4d64-b560-98dc8f54783e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1278b1da-ddaa-45f6-af01-27639a48fb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1278b1da-ddaa-45f6-af01-27639a48fb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-143087057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b54a64-d359-40c8-b5eb-8de8e1e89dff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4ddb51400c34a81b1dec79ce82cc9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:48:51Z,use_quota=True,user_id='21d339a97c2c458da1e0f4611af40481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a0b285-7f58-41a2-882c-f9fb2e1f88a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a0b285-7f58-41a2-882c-f9fb2e1f88a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46abeaee-3a3e-40d4-9e4a-ff976248e0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46abeaee-3a3e-40d4-9e4a-ff976248e0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b54a64-d359-40c8-b5eb-8de8e1e89dff', 'volume_name': 'volume-d3b54a64-d359-40c8-b5eb-8de8e1e89dff', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c30f59-a876-4815-be08-b475d8035dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c30f59-a876-4815-be08-b475d8035dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c38d13-341a-4a7a-a067-accf4bf78ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:51 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Volume d3b54a64-d359-40c8-b5eb-8de8e1e89dff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b54a64-d359-40c8-b5eb-8de8e1e89dff', 'volume_size': 1} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-143087057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b54a64-d359-40c8-b5eb-8de8e1e89dff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4ddb51400c34a81b1dec79ce82cc9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:48:51Z,use_quota=True,user_id='21d339a97c2c458da1e0f4611af40481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Creating volume d3b54a64-d359-40c8-b5eb-8de8e1e89dff {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:48:51 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d3b54a64-d359-40c8-b5eb-8de8e1e89dff 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:51 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=82, name=volume-d3b54a64-d359-40c8-b5eb-8de8e1e89dff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d3b54a64-d359-40c8-b5eb-8de8e1e89dff 1073741824" returned: 0 in 0.348s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d3b54a64-d359-40c8-b5eb-8de8e1e89dff {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d3b54a64-d359-40c8-b5eb-8de8e1e89dff" returned: 0 in 0.144s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] <== create_volume: return (563ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:48:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.575s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:48:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c38d13-341a-4a7a-a067-accf4bf78ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b54a64-d359-40c8-b5eb-8de8e1e89dff', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a59ee7-797d-4478-9d79-9d1e03b6d375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:48:52 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Volume volume-d3b54a64-d359-40c8-b5eb-8de8e1e89dff (d3b54a64-d359-40c8-b5eb-8de8e1e89dff): created successfully Sep 17 07:48:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a59ee7-797d-4478-9d79-9d1e03b6d375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:48:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Flow 'volume_create_manager' (d40c2a64-c21b-4d64-b560-98dc8f54783e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:48:52 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-cd39b230-d98b-47a9-bcff-9f3b1ce97fdf tempest-VolumesListTestJSON-1229592532 None] Created volume successfully. Sep 17 07:48:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "cinder-d3b54a64-d359-40c8-b5eb-8de8e1e89dff-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:48:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Lock "cinder-d3b54a64-d359-40c8-b5eb-8de8e1e89dff-delete_volume" acquired by "delete_volume" :: waited 0.156s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:48:58 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:48:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "cinder-quobyte-d3b54a64-d359-40c8-b5eb-8de8e1e89dff" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:48:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Lock "cinder-quobyte-d3b54a64-d359-40c8-b5eb-8de8e1e89dff" acquired by "delete_volume" :: waited 0.023s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:48:58 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[281d852d-ef50-4691-b5e0-c5b6bd35b718]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:48:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d3b54a64-d359-40c8-b5eb-8de8e1e89dff {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d3b54a64-d359-40c8-b5eb-8de8e1e89dff" returned: 0 in 0.975s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d3b54a64-d359-40c8-b5eb-8de8e1e89dff {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:48:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-d3b54a64-d359-40c8-b5eb-8de8e1e89dff" returned: 0 in 0.228s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:48:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Lock "cinder-quobyte-d3b54a64-d359-40c8-b5eb-8de8e1e89dff" released by "delete_volume" :: held 1.505s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:49:00 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Created reservations ['a0000002-77cc-46f2-a0bc-fe0d9cf09c44', 'bd5d2e3e-be0f-496c-98fe-965d9d884898', '76922ac9-6fd3-48f6-b2ff-485ab586d3d3', 'e92af380-a29f-4ae8-8502-5c9c6e7fa865'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:49:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:49:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:49:00 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:49:00 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:49:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:49:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:49:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.105s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:49:00 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:49:00 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Deleted volume successfully. Sep 17 07:49:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-68feb70b-c8d3-4b6d-8cd4-4128dc785670 tempest-VolumesListTestJSON-1229592532 None] Lock "cinder-d3b54a64-d359-40c8-b5eb-8de8e1e89dff-delete_volume" released by "delete_volume" :: held 2.862s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:49:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "cinder-357544d6-7b3f-4dd6-b908-a431a212e916-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:49:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Lock "cinder-357544d6-7b3f-4dd6-b908-a431a212e916-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:49:02 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:49:02 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "cinder-quobyte-357544d6-7b3f-4dd6-b908-a431a212e916" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:49:02 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Lock "cinder-quobyte-357544d6-7b3f-4dd6-b908-a431a212e916" acquired by "delete_volume" :: waited 0.026s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:49:02 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5431b1a-da37-4c4a-b082-8301bbb90f9d]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:49:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-357544d6-7b3f-4dd6-b908-a431a212e916 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:49:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-357544d6-7b3f-4dd6-b908-a431a212e916" returned: 0 in 0.498s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:49:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-357544d6-7b3f-4dd6-b908-a431a212e916 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:49:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-357544d6-7b3f-4dd6-b908-a431a212e916" returned: 0 in 0.168s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:49:03 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Lock "cinder-quobyte-357544d6-7b3f-4dd6-b908-a431a212e916" released by "delete_volume" :: held 0.925s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:49:04 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Created reservations ['b0dda407-9033-4487-bcf6-7e17ccc78603', 'ef42a153-e355-4e47-bda6-3a1e6930ed6d', '883f7237-3c1d-4d65-a4b5-b2d92c612599', 'cf1e1a56-1074-4b60-a5fd-98658dfba00f'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:49:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:49:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:49:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:49:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:49:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:49:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:49:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.173s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:49:05 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:49:05 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Deleted volume successfully. Sep 17 07:49:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "cinder-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:49:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Lock "cinder-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:49:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aab032aa-cf8a-464a-a453-75d8d8c69fbb tempest-VolumesListTestJSON-1229592532 None] Lock "cinder-357544d6-7b3f-4dd6-b908-a431a212e916-delete_volume" released by "delete_volume" :: held 3.933s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:49:05 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:49:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "cinder-quobyte-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:49:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Lock "cinder-quobyte-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9" acquired by "delete_volume" :: waited 0.033s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:49:06 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccc300b-b529-4c24-a3f8-54e42b5fabd2]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:49:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:49:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9" returned: 0 in 0.427s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:49:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:49:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9" returned: 0 in 0.090s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:49:06 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Lock "cinder-quobyte-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9" released by "delete_volume" :: held 0.738s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:49:06 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Created reservations ['0d413d7a-5e68-499c-a86b-c13bb27ab5d1', 'ce93482d-9dd9-4e6c-b080-c2e80633acf7', 'cfc5fb19-80e5-4c42-85a1-8b33c78c02ab', 'a7d9ca22-7832-4ff6-a046-5759cd5e0046'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:49:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:49:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:49:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:49:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:49:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:49:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:49:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.105s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:49:07 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:49:07 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Deleted volume successfully. Sep 17 07:49:07 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1e4194c6-ff71-4a7b-8957-aae4f76e99b1 tempest-VolumesListTestJSON-1229592532 None] Lock "cinder-7f56dc48-0d1e-4fc5-8dbd-4346fcac8ed9-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:49:12 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:49:12 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:49:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Flow 'volume_create_manager' (a0e980f6-9612-4a71-843f-7d687a81b9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:49:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038dfa51-8492-4817-9cad-e8da7882dea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:49:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038dfa51-8492-4817-9cad-e8da7882dea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1213750935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea993070-d22d-424c-9f72-da17e743f868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a1df6a2f4fa4139acb8c44ae6c205e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:49:13Z,use_quota=True,user_id='ef2efc60e31c49e1a460ef95c3d06bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:49:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf4ec66-44d0-41ac-8a1d-56ddf8dce556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:49:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf4ec66-44d0-41ac-8a1d-56ddf8dce556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdc3feb-d666-43d1-877c-43ee088982df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdc3feb-d666-43d1-877c-43ee088982df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea993070-d22d-424c-9f72-da17e743f868', 'volume_name': 'volume-ea993070-d22d-424c-9f72-da17e743f868', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b17ce0b-39ea-4fe9-9bec-1ffc5f6e7869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b17ce0b-39ea-4fe9-9bec-1ffc5f6e7869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3c2e1d-da4c-4cb2-9222-30a7c197a794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:49:13 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Volume ea993070-d22d-424c-9f72-da17e743f868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea993070-d22d-424c-9f72-da17e743f868', 'volume_size': 1} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1213750935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea993070-d22d-424c-9f72-da17e743f868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a1df6a2f4fa4139acb8c44ae6c205e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:49:13Z,use_quota=True,user_id='ef2efc60e31c49e1a460ef95c3d06bcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Creating volume ea993070-d22d-424c-9f72-da17e743f868 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:49:13 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:49:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ea993070-d22d-424c-9f72-da17e743f868 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:49:13 devstack quobyte-client[83219]: System call of process 95466 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:49:13 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=83, name=volume-ea993070-d22d-424c-9f72-da17e743f868, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:49:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ea993070-d22d-424c-9f72-da17e743f868 1073741824" returned: 0 in 0.966s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:49:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ea993070-d22d-424c-9f72-da17e743f868 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:49:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ea993070-d22d-424c-9f72-da17e743f868" returned: 0 in 0.460s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:49:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] <== create_volume: return (1685ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:49:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:49:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d3c2e1d-da4c-4cb2-9222-30a7c197a794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea993070-d22d-424c-9f72-da17e743f868', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:49:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0626d654-2532-4103-b9df-a514441bd930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:49:15 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Volume volume-ea993070-d22d-424c-9f72-da17e743f868 (ea993070-d22d-424c-9f72-da17e743f868): created successfully Sep 17 07:49:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0626d654-2532-4103-b9df-a514441bd930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:49:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Flow 'volume_create_manager' (a0e980f6-9612-4a71-843f-7d687a81b9b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:49:15 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-00100cde-0b11-4e81-8bd3-04fe5186eac0 tempest-VolumesNegativeTest-663098650 None] Created volume successfully. Sep 17 07:49:25 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=29,cinder:DELETE=2,cinder:SELECT=14,cinder:INSERT=5 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:49:25 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=28,cinder:DELETE=4,cinder:SELECT=20,cinder:INSERT=7 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:49:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:49:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:49:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:49:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:49:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:49:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:49:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:49:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.207s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:49:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:49:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Acquiring lock "cinder-ea993070-d22d-424c-9f72-da17e743f868-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:49:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Lock "cinder-ea993070-d22d-424c-9f72-da17e743f868-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:49:59 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:49:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Acquiring lock "cinder-quobyte-ea993070-d22d-424c-9f72-da17e743f868" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:49:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Lock "cinder-quobyte-ea993070-d22d-424c-9f72-da17e743f868" acquired by "delete_volume" :: waited 0.012s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:49:59 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3164a39-2b5b-467b-b8f3-663e1b4f5f4b]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:49:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ea993070-d22d-424c-9f72-da17e743f868 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ea993070-d22d-424c-9f72-da17e743f868" returned: 0 in 0.408s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ea993070-d22d-424c-9f72-da17e743f868 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ea993070-d22d-424c-9f72-da17e743f868" returned: 0 in 0.179s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Lock "cinder-quobyte-ea993070-d22d-424c-9f72-da17e743f868" released by "delete_volume" :: held 0.695s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:50:00 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Created reservations ['93b5b953-b57c-42b7-bf66-06b10d484d95', 'd6931473-fc13-41c6-ab23-650b49644ba8', 'c83587aa-e05b-40f4-80f2-6ec9ea90e198', '90f297b5-6231-4d9d-af9a-ef63e7b382c5'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:50:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:50:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:50:00 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:50:00 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:50:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:50:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.099s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:01 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:50:01 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Deleted volume successfully. Sep 17 07:50:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-2c54c7c4-d6b5-40cb-9d78-1c6e02132853 tempest-VolumesNegativeTest-663098650 None] Lock "cinder-ea993070-d22d-424c-9f72-da17e743f868-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:50:05 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Flow 'volume_create_manager' (80d2dd83-a495-4f9b-9170-eec424cf8cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59127f3-1afa-466a-ad30-2d68608cf1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c59127f3-1afa-466a-ad30-2d68608cf1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-710975792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3d586d-87f9-4545-a68c-22c0f6867ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb42ef69b3b4e708bd3d9651510cddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:50:05Z,use_quota=True,user_id='5065aaaa10f84f83888ee91b140f32d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4660b698-7d7c-4660-937e-c5b9197684e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4660b698-7d7c-4660-937e-c5b9197684e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d311ff0-4718-49c5-8d6a-36fb96d3a2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d311ff0-4718-49c5-8d6a-36fb96d3a2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c3d586d-87f9-4545-a68c-22c0f6867ebd', 'volume_name': 'volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d839bdf-a8c5-4cff-96b4-8bc500f424c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d839bdf-a8c5-4cff-96b4-8bc500f424c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411b836f-261f-4d95-9da8-abe1a1126b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:50:05 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Volume 4c3d586d-87f9-4545-a68c-22c0f6867ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd', 'volume_size': 1} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-710975792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3d586d-87f9-4545-a68c-22c0f6867ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb42ef69b3b4e708bd3d9651510cddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:50:05Z,use_quota=True,user_id='5065aaaa10f84f83888ee91b140f32d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Creating volume 4c3d586d-87f9-4545-a68c-22c0f6867ebd {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:50:05 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:50:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:06 devstack quobyte-client[83219]: System call of process 95722 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:50:06 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=84, name=volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:50:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd 1073741824" returned: 0 in 0.421s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd" returned: 0 in 0.090s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] <== create_volume: return (583ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:50:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.599s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:50:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411b836f-261f-4d95-9da8-abe1a1126b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:50:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544d6566-5324-42e5-a9c1-2d7d963d5117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:50:06 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Volume volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd (4c3d586d-87f9-4545-a68c-22c0f6867ebd): created successfully Sep 17 07:50:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544d6566-5324-42e5-a9c1-2d7d963d5117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:50:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Flow 'volume_create_manager' (80d2dd83-a495-4f9b-9170-eec424cf8cc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:50:06 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-85c1720b-1ab8-47ab-a617-0d8a7c755b5c tempest-VolumesSnapshotListTestJSON-10035833 None] Created volume successfully. Sep 17 07:50:07 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:50:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:50:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:50:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] Creating offline snapshot c555401e-eb48-47e9-86dd-5c8af78fbc43 of volume 4c3d586d-87f9-4545-a68c-22c0f6867ebd {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:50:08 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4856167a-5e11-4573-8435-6b4c19d9704b]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:50:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd" returned: 0 in 0.458s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:08 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=85, name=volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:50:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 1G" returned: 0 in 0.272s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "qemu-img rebase -u -b volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43" returned: 0 in 0.165s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:50:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43" returned: 0 in 0.116s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:50:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43" returned: 0 in 0.105s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.info" returned: 0 in 0.101s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:50:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.info" returned: 0 in 0.088s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.903s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:50:10 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-64916ee4-a597-461c-95a5-de2efdc97594 tempest-VolumesSnapshotListTestJSON-10035833 None] Create snapshot completed successfully Sep 17 07:50:11 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:50:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:50:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:50:11 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] Creating offline snapshot 776222d4-6d93-429c-897b-a8a2edfca778 of volume 4c3d586d-87f9-4545-a68c-22c0f6867ebd {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:50:11 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbabf64-bf1f-4fa3-aad5-e6d649384589]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:50:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43" returned: 0 in 0.478s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:50:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:12 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=87, name=volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:50:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 1G" returned: 0 in 0.372s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "qemu-img rebase -u -b volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778" returned: 0 in 0.171s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:50:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778" returned: 0 in 0.089s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:50:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778" returned: 0 in 0.084s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.506s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:50:13 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-8796f317-94f2-4801-aff8-c7480fc3ed14 tempest-VolumesSnapshotListTestJSON-10035833 None] Create snapshot completed successfully Sep 17 07:50:13 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:50:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:50:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:50:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] Creating offline snapshot ab8a5993-9a33-4042-bf2b-98879838c7a5 of volume 4c3d586d-87f9-4545-a68c-22c0f6867ebd {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:50:14 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0e25a4-a1e8-4c1b-b39a-3519efd04289]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:50:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778" returned: 0 in 0.450s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:50:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:14 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=88, name=volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:50:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5 1G" returned: 0 in 0.339s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "qemu-img rebase -u -b volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5" returned: 0 in 0.174s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:50:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5" returned: 0 in 0.091s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:50:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5" returned: 0 in 0.117s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.521s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:50:15 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-99c47b9b-b33d-4083-acab-285a54c923ed tempest-VolumesSnapshotListTestJSON-10035833 None] Create snapshot completed successfully Sep 17 07:50:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "cinder-ab8a5993-9a33-4042-bf2b-98879838c7a5-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:50:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-ab8a5993-9a33-4042-bf2b-98879838c7a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:50:17 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:50:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "cinder-quobyte-4c3d586d-87f9-4545-a68c-22c0f6867ebd" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:50:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-quobyte-4c3d586d-87f9-4545-a68c-22c0f6867ebd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:50:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "cinder-quobyte-ab8a5993-9a33-4042-bf2b-98879838c7a5" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:50:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-quobyte-ab8a5993-9a33-4042-bf2b-98879838c7a5" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:50:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Deleting offline snapshot ab8a5993-9a33-4042-bf2b-98879838c7a5 of volume 4c3d586d-87f9-4545-a68c-22c0f6867ebd {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:50:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] snapshot_file for this snap is: volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:50:17 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfd4f51-63ca-40a5-8c95-abf2933b4f9d]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:50:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5" returned: 0 in 0.448s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:50:18 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[539ca07b-168f-4b3b-bb44-db89859d24e4]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:50:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778" returned: 0 in 0.414s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:50:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5" returned: 0 in 0.357s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.ab8a5993-9a33-4042-bf2b-98879838c7a5" returned: 0 in 0.087s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-quobyte-ab8a5993-9a33-4042-bf2b-98879838c7a5" released by "_delete_snapshot" :: held 1.639s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:50:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-quobyte-4c3d586d-87f9-4545-a68c-22c0f6867ebd" released by "delete_snapshot" :: held 1.664s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:50:19 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Created reservations ['bfd5b1e0-0c3e-455b-b5ce-b05bd56c14fe', 'adb6c309-eb43-418d-a482-3dad2f6351c8', '6a7a52ba-69fc-4f5d-86da-ccba57667516', 'fb002ddd-ce1e-4768-87be-d41175efed46'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:50:19 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Delete snapshot completed successfully. Sep 17 07:50:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d0d7d384-1b14-4b2d-ade8-a4758cafc4c8 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-ab8a5993-9a33-4042-bf2b-98879838c7a5-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:50:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "cinder-776222d4-6d93-429c-897b-a8a2edfca778-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:50:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-776222d4-6d93-429c-897b-a8a2edfca778-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:50:21 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:50:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "cinder-quobyte-4c3d586d-87f9-4545-a68c-22c0f6867ebd" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:50:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-quobyte-4c3d586d-87f9-4545-a68c-22c0f6867ebd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:50:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "cinder-quobyte-776222d4-6d93-429c-897b-a8a2edfca778" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:50:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-quobyte-776222d4-6d93-429c-897b-a8a2edfca778" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:50:21 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Deleting offline snapshot 776222d4-6d93-429c-897b-a8a2edfca778 of volume 4c3d586d-87f9-4545-a68c-22c0f6867ebd {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:50:21 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] snapshot_file for this snap is: volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:50:21 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1895474-bd80-4125-a91e-dc10c09e5c23]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:50:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778" returned: 0 in 0.421s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:21 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:50:21 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fb4188-3787-4ac4-8d11-0a8515bab40b]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:50:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43" returned: 0 in 0.645s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:50:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778" returned: 0 in 0.298s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.776222d4-6d93-429c-897b-a8a2edfca778" returned: 0 in 0.097s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-quobyte-776222d4-6d93-429c-897b-a8a2edfca778" released by "_delete_snapshot" :: held 1.833s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:50:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-quobyte-4c3d586d-87f9-4545-a68c-22c0f6867ebd" released by "delete_snapshot" :: held 1.877s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:50:23 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Created reservations ['e50beaf1-f49a-4bcc-a9ee-83ce0ab36cdf', 'e5c8894e-2d36-4cbd-a3e6-f189abd920c4', 'a008e64c-0e2d-48ca-a325-de66367bc240', '2789b1b4-c580-47b0-ba20-62a840acc517'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:50:23 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Delete snapshot completed successfully. Sep 17 07:50:23 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7077ac5c-d5a2-4161-b4ea-f1254b995560 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-776222d4-6d93-429c-897b-a8a2edfca778-delete_snapshot" released by "delete_snapshot" :: held 2.343s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "cinder-c555401e-eb48-47e9-86dd-5c8af78fbc43-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-c555401e-eb48-47e9-86dd-5c8af78fbc43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:50:24 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "cinder-quobyte-4c3d586d-87f9-4545-a68c-22c0f6867ebd" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-quobyte-4c3d586d-87f9-4545-a68c-22c0f6867ebd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "cinder-quobyte-c555401e-eb48-47e9-86dd-5c8af78fbc43" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-quobyte-c555401e-eb48-47e9-86dd-5c8af78fbc43" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Deleting offline snapshot c555401e-eb48-47e9-86dd-5c8af78fbc43 of volume 4c3d586d-87f9-4545-a68c-22c0f6867ebd {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] snapshot_file for this snap is: volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3e82c8-f260-418b-8f59-de79fd94e553]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:24 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Flow 'volume_create_manager' (7c21d78f-485e-4c36-a037-31facddc58ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eca55da-11e8-4383-bf1c-e0c6a29956dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eca55da-11e8-4383-bf1c-e0c6a29956dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-940147708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daff8b33-596e-48ea-a9de-a4537c3ef901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b6c31b39b441a49e3bec65c7dd729b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:50:24Z,use_quota=True,user_id='46cbd748b39b4028a306b40a9a741c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a8f0e8-7167-4be5-a23c-08bc1451723e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a8f0e8-7167-4be5-a23c-08bc1451723e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacdc693-7acd-463c-ab6d-0ee30bf91064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacdc693-7acd-463c-ab6d-0ee30bf91064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daff8b33-596e-48ea-a9de-a4537c3ef901', 'volume_name': 'volume-daff8b33-596e-48ea-a9de-a4537c3ef901', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb14c02-6709-4633-b498-1a386980beff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:50:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb14c02-6709-4633-b498-1a386980beff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287d49f7-9251-44e5-8864-20a8a27b50c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:50:25 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Volume daff8b33-596e-48ea-a9de-a4537c3ef901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daff8b33-596e-48ea-a9de-a4537c3ef901', 'volume_size': 1} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-940147708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daff8b33-596e-48ea-a9de-a4537c3ef901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b6c31b39b441a49e3bec65c7dd729b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:50:24Z,use_quota=True,user_id='46cbd748b39b4028a306b40a9a741c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Creating volume daff8b33-596e-48ea-a9de-a4537c3ef901 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:50:25 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daff8b33-596e-48ea-a9de-a4537c3ef901 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:25 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=89, name=volume-daff8b33-596e-48ea-a9de-a4537c3ef901, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43" returned: 0 in 0.715s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7735993f-aaa2-4d1d-9c55-ce66caccff57]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daff8b33-596e-48ea-a9de-a4537c3ef901 1073741824" returned: 0 in 0.382s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daff8b33-596e-48ea-a9de-a4537c3ef901 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daff8b33-596e-48ea-a9de-a4537c3ef901" returned: 0 in 0.103s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] <== create_volume: return (593ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.605s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287d49f7-9251-44e5-8864-20a8a27b50c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daff8b33-596e-48ea-a9de-a4537c3ef901', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c06fe6-e159-41af-9fd5-844ff55b5e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd" returned: 0 in 0.640s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:26 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Volume volume-daff8b33-596e-48ea-a9de-a4537c3ef901 (daff8b33-596e-48ea-a9de-a4537c3ef901): created successfully Sep 17 07:50:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c06fe6-e159-41af-9fd5-844ff55b5e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:50:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Flow 'volume_create_manager' (7c21d78f-485e-4c36-a037-31facddc58ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:50:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43" returned: 0 in 0.366s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:26 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-83728836-c8f9-4214-9dba-7f66ff4a8d86 tempest-AttachVolumeNegativeTest-1634306197 None] Created volume successfully. Sep 17 07:50:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd.c555401e-eb48-47e9-86dd-5c8af78fbc43" returned: 0 in 0.232s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-quobyte-c555401e-eb48-47e9-86dd-5c8af78fbc43" released by "_delete_snapshot" :: held 2.200s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:50:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-quobyte-4c3d586d-87f9-4545-a68c-22c0f6867ebd" released by "delete_snapshot" :: held 2.244s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:50:26 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Created reservations ['1260983f-7391-4f8b-a85e-ec8433003a75', 'c390f94c-5aae-45f6-885b-13f942ff69c1', '6c41ff7b-a3ba-4e69-83cd-0d3b452b6259', '594d1554-6b2d-4765-a0e1-534bb7f04271'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:50:26 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Delete snapshot completed successfully. Sep 17 07:50:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-aa07cc81-112e-4268-96f8-4c8693078012 tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-c555401e-eb48-47e9-86dd-5c8af78fbc43-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:50:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "cinder-4c3d586d-87f9-4545-a68c-22c0f6867ebd-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:50:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-4c3d586d-87f9-4545-a68c-22c0f6867ebd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:50:27 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:50:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "cinder-quobyte-4c3d586d-87f9-4545-a68c-22c0f6867ebd" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:50:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-quobyte-4c3d586d-87f9-4545-a68c-22c0f6867ebd" acquired by "delete_volume" :: waited 0.012s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:50:27 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f2d0af-a11d-4bb4-9fbe-8688460142e1]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:50:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:50:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:50:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:50:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:50:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:50:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:50:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.158s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:50:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd" returned: 0 in 0.537s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4c3d586d-87f9-4545-a68c-22c0f6867ebd" returned: 0 in 0.109s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-quobyte-4c3d586d-87f9-4545-a68c-22c0f6867ebd" released by "delete_volume" :: held 0.802s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:50:28 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Created reservations ['2c9bd5c1-d72e-42a5-b79e-75dd7957fd6a', 'dc294366-d78a-4eee-a125-ee843baf09d7', 'acdfb971-ed61-41bf-bed7-f682fe880732', '40e15dd5-95a1-4841-ac98-2e88ffc89426'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:50:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:50:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:50:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:50:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:50:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:50:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.134s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:29 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:50:29 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Deleted volume successfully. Sep 17 07:50:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b504e615-6a49-4983-b244-920daf2cb87a tempest-VolumesSnapshotListTestJSON-10035833 None] Lock "cinder-4c3d586d-87f9-4545-a68c-22c0f6867ebd-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:50:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-824aa51a-fb8f-4242-92b3-23d8ea3bb9ec req-132312fc-ce7a-485d-b35a-6f66b77a857a tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:50:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-824aa51a-fb8f-4242-92b3-23d8ea3bb9ec req-132312fc-ce7a-485d-b35a-6f66b77a857a tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:50:30 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7e8fe8-2f60-4e7b-b0c7-0e3178b7cf32]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:50:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-824aa51a-fb8f-4242-92b3-23d8ea3bb9ec req-132312fc-ce7a-485d-b35a-6f66b77a857a tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daff8b33-596e-48ea-a9de-a4537c3ef901 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:50:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-824aa51a-fb8f-4242-92b3-23d8ea3bb9ec req-132312fc-ce7a-485d-b35a-6f66b77a857a tempest-AttachVolumeNegativeTest-1634306197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daff8b33-596e-48ea-a9de-a4537c3ef901" returned: 0 in 0.443s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:50:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-824aa51a-fb8f-4242-92b3-23d8ea3bb9ec req-132312fc-ce7a-485d-b35a-6f66b77a857a tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.502s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:50:31 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-824aa51a-fb8f-4242-92b3-23d8ea3bb9ec req-132312fc-ce7a-485d-b35a-6f66b77a857a tempest-AttachVolumeNegativeTest-1634306197 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-daff8b33-596e-48ea-a9de-a4537c3ef901', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa09c554-2aa0-434e-85d8-6958ebf02594', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:50:31 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-824aa51a-fb8f-4242-92b3-23d8ea3bb9ec req-132312fc-ce7a-485d-b35a-6f66b77a857a tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:50:31 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-824aa51a-fb8f-4242-92b3-23d8ea3bb9ec req-132312fc-ce7a-485d-b35a-6f66b77a857a tempest-AttachVolumeNegativeTest-1634306197 None] attachment_update completed successfully. Sep 17 07:50:41 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=38,cinder:INSERT=15,cinder:UPDATE=40,cinder:DELETE=3 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:50:41 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=34,cinder:UPDATE=43,cinder:INSERT=5,cinder:DELETE=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:51:01 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-db8fee59-6a2b-4c45-9eab-946c2204c2b3 req-2e6f24a3-93f0-4cb0-8663-1c0a40cbfe8b tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:51:01 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-db8fee59-6a2b-4c45-9eab-946c2204c2b3 req-2e6f24a3-93f0-4cb0-8663-1c0a40cbfe8b tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:51:01 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-db8fee59-6a2b-4c45-9eab-946c2204c2b3 req-2e6f24a3-93f0-4cb0-8663-1c0a40cbfe8b tempest-AttachVolumeNegativeTest-1634306197 None] Terminate volume connection completed successfully. Sep 17 07:51:01 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-db8fee59-6a2b-4c45-9eab-946c2204c2b3 req-2e6f24a3-93f0-4cb0-8663-1c0a40cbfe8b tempest-AttachVolumeNegativeTest-1634306197 None] Deleting attachment fa09c554-2aa0-434e-85d8-6958ebf02594. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:51:11 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:51:11 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:51:25 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Flow 'volume_create_manager' (0d263f7c-1497-4e79-99d4-d21a7217653a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52d3d25-1682-4d1b-a961-329f00cc74d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52d3d25-1682-4d1b-a961-329f00cc74d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-728388022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790e2d02-7813-4006-99da-099c7a47a07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25311673fe6a4076bfdec310c4e26c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:51:25Z,use_quota=True,user_id='affd4b06d8514de6a9578396f33e821f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9858a6f-3e9b-4f28-a040-be4524a3f506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9858a6f-3e9b-4f28-a040-be4524a3f506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0507dd38-d4df-49ec-a71f-d196726eecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0507dd38-d4df-49ec-a71f-d196726eecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790e2d02-7813-4006-99da-099c7a47a07e', 'volume_name': 'volume-790e2d02-7813-4006-99da-099c7a47a07e', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6cafc6-7353-4e60-a6bb-060d765fc25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6cafc6-7353-4e60-a6bb-060d765fc25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c7ad06-2361-4c95-ac31-fab4c2578ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:51:25 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Volume 790e2d02-7813-4006-99da-099c7a47a07e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790e2d02-7813-4006-99da-099c7a47a07e', 'volume_size': 1} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-728388022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790e2d02-7813-4006-99da-099c7a47a07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25311673fe6a4076bfdec310c4e26c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:51:25Z,use_quota=True,user_id='affd4b06d8514de6a9578396f33e821f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Creating volume 790e2d02-7813-4006-99da-099c7a47a07e {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:51:25 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-790e2d02-7813-4006-99da-099c7a47a07e 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:51:25 devstack quobyte-client[83219]: System call of process 96476 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:51:25 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=90, name=volume-790e2d02-7813-4006-99da-099c7a47a07e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-790e2d02-7813-4006-99da-099c7a47a07e 1073741824" returned: 0 in 0.399s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-790e2d02-7813-4006-99da-099c7a47a07e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-790e2d02-7813-4006-99da-099c7a47a07e" returned: 0 in 0.129s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] <== create_volume: return (612ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:51:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.629s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:51:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c7ad06-2361-4c95-ac31-fab4c2578ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790e2d02-7813-4006-99da-099c7a47a07e', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:51:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f73b3f3-8645-4da4-ae0f-f0f8ba48ef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:51:26 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Volume volume-790e2d02-7813-4006-99da-099c7a47a07e (790e2d02-7813-4006-99da-099c7a47a07e): created successfully Sep 17 07:51:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f73b3f3-8645-4da4-ae0f-f0f8ba48ef39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:51:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Flow 'volume_create_manager' (0d263f7c-1497-4e79-99d4-d21a7217653a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:51:26 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c4ec0136-075b-48bf-81cb-650da70c7321 tempest-TestMinimumBasicScenario-600811562 None] Created volume successfully. Sep 17 07:51:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:51:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:51:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:51:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:51:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:51:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:51:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:51:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.097s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:51:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:51:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-41380cee-4efb-4b2d-a6d0-bc914b03d4d6 req-3b809803-8d23-44e6-bf92-1fea9971e1b6 tempest-TestMinimumBasicScenario-600811562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:51:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-41380cee-4efb-4b2d-a6d0-bc914b03d4d6 req-3b809803-8d23-44e6-bf92-1fea9971e1b6 tempest-TestMinimumBasicScenario-600811562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:51:35 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[335dfdf9-f5a6-48b3-ba22-d04215213f99]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:51:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-41380cee-4efb-4b2d-a6d0-bc914b03d4d6 req-3b809803-8d23-44e6-bf92-1fea9971e1b6 tempest-TestMinimumBasicScenario-600811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-790e2d02-7813-4006-99da-099c7a47a07e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:51:36 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:51:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-41380cee-4efb-4b2d-a6d0-bc914b03d4d6 req-3b809803-8d23-44e6-bf92-1fea9971e1b6 tempest-TestMinimumBasicScenario-600811562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-790e2d02-7813-4006-99da-099c7a47a07e" returned: 0 in 1.265s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:51:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-41380cee-4efb-4b2d-a6d0-bc914b03d4d6 req-3b809803-8d23-44e6-bf92-1fea9971e1b6 tempest-TestMinimumBasicScenario-600811562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.381s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:51:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-41380cee-4efb-4b2d-a6d0-bc914b03d4d6 req-3b809803-8d23-44e6-bf92-1fea9971e1b6 tempest-TestMinimumBasicScenario-600811562 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-790e2d02-7813-4006-99da-099c7a47a07e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c59131e-2a4f-4438-bf10-610e2d5feb74', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:51:37 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-41380cee-4efb-4b2d-a6d0-bc914b03d4d6 req-3b809803-8d23-44e6-bf92-1fea9971e1b6 tempest-TestMinimumBasicScenario-600811562 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:51:37 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-41380cee-4efb-4b2d-a6d0-bc914b03d4d6 req-3b809803-8d23-44e6-bf92-1fea9971e1b6 tempest-TestMinimumBasicScenario-600811562 None] attachment_update completed successfully. Sep 17 07:51:47 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:51:47 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:52:06 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:52:06 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:52:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:52:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:52:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:52:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:52:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:52:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:52:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:52:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.115s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:52:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:53:02 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Flow 'volume_create_manager' (0ac95654-e484-4b34-a2d7-411d98fd4d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fb2e9f-6bc8-40d7-9dde-60c8a181b056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fb2e9f-6bc8-40d7-9dde-60c8a181b056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1160131783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5b559d-c7cb-4225-a3d4-a77e1c186f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b6c31b39b441a49e3bec65c7dd729b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:53:02Z,use_quota=True,user_id='46cbd748b39b4028a306b40a9a741c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f84b56-89ef-4328-9f73-dc22121c1231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f84b56-89ef-4328-9f73-dc22121c1231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6028f3b-56f0-4811-ab64-91b7a66189a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6028f3b-56f0-4811-ab64-91b7a66189a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d5b559d-c7cb-4225-a3d4-a77e1c186f22', 'volume_name': 'volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fd3829-2627-470c-b6ba-fd223b7cbb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fd3829-2627-470c-b6ba-fd223b7cbb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e544a5be-74f2-4acd-87bf-754cd477e70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:53:02 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Volume 8d5b559d-c7cb-4225-a3d4-a77e1c186f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22', 'volume_size': 1} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1160131783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5b559d-c7cb-4225-a3d4-a77e1c186f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b6c31b39b441a49e3bec65c7dd729b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:53:02Z,use_quota=True,user_id='46cbd748b39b4028a306b40a9a741c5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Creating volume 8d5b559d-c7cb-4225-a3d4-a77e1c186f22 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:53:02 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:53:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:53:03 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=91, name=volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:53:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22 1073741824" returned: 0 in 0.532s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:53:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:53:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22" returned: 0 in 0.146s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:53:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] <== create_volume: return (777ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:53:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:53:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e544a5be-74f2-4acd-87bf-754cd477e70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:53:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd854d0-979e-49dc-9cea-3c49cea8ff1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:53:03 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Volume volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22 (8d5b559d-c7cb-4225-a3d4-a77e1c186f22): created successfully Sep 17 07:53:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd854d0-979e-49dc-9cea-3c49cea8ff1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:53:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Flow 'volume_create_manager' (0ac95654-e484-4b34-a2d7-411d98fd4d84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:53:04 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-fde6186f-0d81-4366-802b-3c456c74e023 tempest-AttachVolumeNegativeTest-1634306197 None] Created volume successfully. Sep 17 07:53:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-034e0611-8e93-44a3-8683-b202c84fc7a2 req-6705f844-4a0d-46e9-89e3-27b0a82ebcf5 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:53:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-034e0611-8e93-44a3-8683-b202c84fc7a2 req-6705f844-4a0d-46e9-89e3-27b0a82ebcf5 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:53:09 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ef65a9-5354-47a3-917d-a9f1a6e47d77]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:53:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-034e0611-8e93-44a3-8683-b202c84fc7a2 req-6705f844-4a0d-46e9-89e3-27b0a82ebcf5 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:53:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-034e0611-8e93-44a3-8683-b202c84fc7a2 req-6705f844-4a0d-46e9-89e3-27b0a82ebcf5 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22" returned: 0 in 0.487s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:53:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-034e0611-8e93-44a3-8683-b202c84fc7a2 req-6705f844-4a0d-46e9-89e3-27b0a82ebcf5 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.558s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:53:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-034e0611-8e93-44a3-8683-b202c84fc7a2 req-6705f844-4a0d-46e9-89e3-27b0a82ebcf5 tempest-AttachVolumeNegativeTest-1634306197 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83a8f08f-270e-4bde-a78e-1bb2d4c2b51a', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:53:10 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-034e0611-8e93-44a3-8683-b202c84fc7a2 req-6705f844-4a0d-46e9-89e3-27b0a82ebcf5 tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:53:10 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-034e0611-8e93-44a3-8683-b202c84fc7a2 req-6705f844-4a0d-46e9-89e3-27b0a82ebcf5 tempest-AttachVolumeNegativeTest-1634306197 None] attachment_update completed successfully. Sep 17 07:53:20 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:53:20 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=6 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:53:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:53:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:53:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:53:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:53:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:53:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:53:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:53:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.091s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:53:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:53:39 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-0de49429-173f-49eb-84bf-7082af72515a req-3dbaf0e1-1e48-4de1-a773-ab1d7cc32d97 tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:53:39 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-0de49429-173f-49eb-84bf-7082af72515a req-3dbaf0e1-1e48-4de1-a773-ab1d7cc32d97 tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:53:39 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-0de49429-173f-49eb-84bf-7082af72515a req-3dbaf0e1-1e48-4de1-a773-ab1d7cc32d97 tempest-AttachVolumeNegativeTest-1634306197 None] Terminate volume connection completed successfully. Sep 17 07:53:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-0de49429-173f-49eb-84bf-7082af72515a req-3dbaf0e1-1e48-4de1-a773-ab1d7cc32d97 tempest-AttachVolumeNegativeTest-1634306197 None] Deleting attachment 83a8f08f-270e-4bde-a78e-1bb2d4c2b51a. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:53:49 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:53:49 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:53:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "cinder-8d5b559d-c7cb-4225-a3d4-a77e1c186f22-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:53:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "cinder-8d5b559d-c7cb-4225-a3d4-a77e1c186f22-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:53:52 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:53:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "cinder-quobyte-8d5b559d-c7cb-4225-a3d4-a77e1c186f22" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:53:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "cinder-quobyte-8d5b559d-c7cb-4225-a3d4-a77e1c186f22" acquired by "delete_volume" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:53:52 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee55bc71-458f-40cd-8687-e97324b67e2f]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:53:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:53:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22" returned: 0 in 0.524s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:53:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:53:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8d5b559d-c7cb-4225-a3d4-a77e1c186f22" returned: 0 in 0.101s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:53:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "cinder-quobyte-8d5b559d-c7cb-4225-a3d4-a77e1c186f22" released by "delete_volume" :: held 0.792s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:53:54 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Created reservations ['3b39f71d-80e2-410c-ab78-5ab568dbcdc6', '1c0f1bd1-b1b9-4d87-86fb-e74129dc7017', '6f491139-b3b0-4e83-aa36-7c0431de6e91', 'ba23a711-601c-4eb3-9e61-5dfbe8c87281'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:53:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:53:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:53:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:53:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:53:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:53:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:53:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.184s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:53:54 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:53:54 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Deleted volume successfully. Sep 17 07:53:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-58923a67-3de1-4456-8d43-2cbf32ba4e47 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "cinder-8d5b559d-c7cb-4225-a3d4-a77e1c186f22-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:53:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "cinder-daff8b33-596e-48ea-a9de-a4537c3ef901-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:53:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "cinder-daff8b33-596e-48ea-a9de-a4537c3ef901-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:53:55 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:53:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "cinder-quobyte-daff8b33-596e-48ea-a9de-a4537c3ef901" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:53:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "cinder-quobyte-daff8b33-596e-48ea-a9de-a4537c3ef901" acquired by "delete_volume" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:53:55 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6448a3db-d823-4428-bbf5-055d5c151df0]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:53:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daff8b33-596e-48ea-a9de-a4537c3ef901 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:53:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daff8b33-596e-48ea-a9de-a4537c3ef901" returned: 0 in 1.047s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:53:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daff8b33-596e-48ea-a9de-a4537c3ef901 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:53:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daff8b33-596e-48ea-a9de-a4537c3ef901" returned: 0 in 0.179s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:53:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "cinder-quobyte-daff8b33-596e-48ea-a9de-a4537c3ef901" released by "delete_volume" :: held 1.431s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:53:57 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Created reservations ['c2a3c8b3-e257-41c7-a7d8-7df29fbca6ea', 'ec1e7d6a-93e7-4dda-a993-26de59e49a66', 'e07b7c8f-9f9a-4c22-945e-9014fb6273a2', 'b7d7877d-58aa-4013-9aeb-cdeb211a718d'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:53:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:53:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:53:57 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:53:57 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:53:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:53:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:53:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.237s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:53:57 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:53:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Deleted volume successfully. Sep 17 07:53:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "cinder-57ce7f5d-7d51-4a34-af96-a6e7751811cb-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:53:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4cc94d14-34c7-45d3-99f9-5afab38c4766 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "cinder-daff8b33-596e-48ea-a9de-a4537c3ef901-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:53:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "cinder-57ce7f5d-7d51-4a34-af96-a6e7751811cb-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:53:58 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:53:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "cinder-quobyte-57ce7f5d-7d51-4a34-af96-a6e7751811cb" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:53:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "cinder-quobyte-57ce7f5d-7d51-4a34-af96-a6e7751811cb" acquired by "delete_volume" :: waited 0.012s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:53:58 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6495282c-1e14-4b83-8e44-2f3ea37e84d3]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:53:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:53:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb" returned: 0 in 0.417s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:53:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:53:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-57ce7f5d-7d51-4a34-af96-a6e7751811cb" returned: 0 in 0.092s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:53:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "cinder-quobyte-57ce7f5d-7d51-4a34-af96-a6e7751811cb" released by "delete_volume" :: held 0.689s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:53:59 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Created reservations ['1e257b95-8030-4da1-9e5d-08766026df2e', 'b842a7cf-0714-444e-aa71-3d0ba7179af9', '9532a24e-93a0-4f3b-8773-e84cf48c27f2', '7239e9fc-b3bf-44a2-ba32-aaace0d52397'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:53:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:53:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:53:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:53:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:53:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:53:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:53:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.108s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:53:59 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:54:00 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Deleted volume successfully. Sep 17 07:54:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-597b7a2c-c962-4b0b-9ff3-253576fa7502 tempest-AttachVolumeNegativeTest-1634306197 None] Lock "cinder-57ce7f5d-7d51-4a34-af96-a6e7751811cb-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:54:09 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=16,cinder:INSERT=5,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:54:10 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=21,cinder:SELECT=15,cinder:INSERT=7,cinder:DELETE=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:54:11 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-eb02022d-46c5-4b66-98de-1973d6fa0c26 tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:11 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-eb02022d-46c5-4b66-98de-1973d6fa0c26 tempest-GroupSnapshotsTest-1568143229 None] Group tempest-GroupSnapshotsTest-Group-992720138: creating Sep 17 07:54:11 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-eb02022d-46c5-4b66-98de-1973d6fa0c26 tempest-GroupSnapshotsTest-1568143229 None] Group tempest-GroupSnapshotsTest-Group-992720138: created successfully Sep 17 07:54:11 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-eb02022d-46c5-4b66-98de-1973d6fa0c26 tempest-GroupSnapshotsTest-1568143229 None] Create group completed successfully. Sep 17 07:54:12 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:12 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Flow 'volume_create_manager' (34049765-c6c4-4111-b084-3501f5452cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aad08f4-53a6-4910-8b4f-d1ff64ee11f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aad08f4-53a6-4910-8b4f-d1ff64ee11f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-41565297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2805519-a2c4-4619-9d35-e2c64af8be24,host='devstack@QuobyteHD#QuobyteHD',id=0e23f0f3-107c-4c54-aaa1-b2c406376501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='002aa0e38a004ac89e5d0152575e0dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:54:13Z,use_quota=True,user_id='08a6a01abe9d4c629aa6d3aa32b612a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c36e9540-2c3e-4625-a0f4-f4bac2d20b80),volume_type_id=c36e9540-2c3e-4625-a0f4-f4bac2d20b80)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49aa730b-ca17-471e-b123-9ab30e3eff23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49aa730b-ca17-471e-b123-9ab30e3eff23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc4153d-6c6b-492f-a372-ce463ef96a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc4153d-6c6b-492f-a372-ce463ef96a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e23f0f3-107c-4c54-aaa1-b2c406376501', 'volume_name': 'volume-0e23f0f3-107c-4c54-aaa1-b2c406376501', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5991ef-69b0-4c4f-a86f-91a5c0e93d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5991ef-69b0-4c4f-a86f-91a5c0e93d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf61de7b-3021-4183-ae40-442dfbbd72cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:13 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Volume 0e23f0f3-107c-4c54-aaa1-b2c406376501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e23f0f3-107c-4c54-aaa1-b2c406376501', 'volume_size': 1} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b2805519-a2c4-4619-9d35-e2c64af8be24,created_at=2025-09-17T05:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-41565297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b2805519-a2c4-4619-9d35-e2c64af8be24,host='devstack@QuobyteHD#QuobyteHD',id=0e23f0f3-107c-4c54-aaa1-b2c406376501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='002aa0e38a004ac89e5d0152575e0dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:54:13Z,use_quota=True,user_id='08a6a01abe9d4c629aa6d3aa32b612a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c36e9540-2c3e-4625-a0f4-f4bac2d20b80),volume_type_id=c36e9540-2c3e-4625-a0f4-f4bac2d20b80)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Creating volume 0e23f0f3-107c-4c54-aaa1-b2c406376501 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:54:13 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:13 devstack quobyte-client[83219]: System call of process 97487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:54:13 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=92, name=volume-0e23f0f3-107c-4c54-aaa1-b2c406376501, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 1073741824" returned: 0 in 0.330s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501" returned: 0 in 0.081s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] <== create_volume: return (471ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.482s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf61de7b-3021-4183-ae40-442dfbbd72cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e23f0f3-107c-4c54-aaa1-b2c406376501', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b75208-dc18-43b8-a908-11db96b6dfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:13 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Volume volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 (0e23f0f3-107c-4c54-aaa1-b2c406376501): created successfully Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b75208-dc18-43b8-a908-11db96b6dfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Flow 'volume_create_manager' (34049765-c6c4-4111-b084-3501f5452cc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:54:13 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-359e8ba4-79f5-4889-831c-4452d5fa4218 tempest-GroupSnapshotsTest-1568143229 None] Created volume successfully. Sep 17 07:54:14 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] GroupSnapshot 8f335617-45c0-44df-abf2-21fb3380844f: creating. Sep 17 07:54:14 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] Group snapshot 8f335617-45c0-44df-abf2-21fb3380844f: creating. {{(pid=83207) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 17 07:54:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] Creating offline snapshot d5f3700c-d64a-4d36-be4e-239b41056507 of volume 0e23f0f3-107c-4c54-aaa1-b2c406376501 {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:54:14 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b5c60f-098f-4fc8-b5b0-1f6128be2d2d]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501" returned: 0 in 0.418s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:15 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=93, name=volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507 1G" returned: 0 in 0.253s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:15 devstack quobyte-client[83219]: System call of process 97498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img rebase -u -b volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507" returned: 0 in 0.131s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507" returned: 0 in 0.113s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507" returned: 0 in 0.105s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.info" returned: 0 in 0.089s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.info" returned: 0 in 0.081s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.470s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:16 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-00e6dd6e-d8b3-43c2-ab13-b96bf19b6e26 tempest-GroupSnapshotsTest-1568143229 None] group_snapshot 8f335617-45c0-44df-abf2-21fb3380844f: created successfully Sep 17 07:54:17 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-d5f3700c-d64a-4d36-be4e-239b41056507-532a40cb-6ee7-47ac-a521-f37d548b6d00" by "_create_volume_from_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-d5f3700c-d64a-4d36-be4e-239b41056507-532a40cb-6ee7-47ac-a521-f37d548b6d00" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Creating volume 532a40cb-6ee7-47ac-a521-f37d548b6d00 from snapshot d5f3700c-d64a-4d36-be4e-239b41056507 {{(pid=83207) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-532a40cb-6ee7-47ac-a521-f37d548b6d00" by "_copy_volume_from_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-532a40cb-6ee7-47ac-a521-f37d548b6d00" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] snapshot: d5f3700c-d64a-4d36-be4e-239b41056507, volume: 532a40cb-6ee7-47ac-a521-f37d548b6d00, {{(pid=83207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3c4ab6-c045-47ea-92ae-537a5225c3b0]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507" returned: 0 in 0.398s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e23f0f3-107c-4c54-aaa1-b2c406376501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] will copy from snapshot at /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 {{(pid=83207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Creating direct copy from snapshot {{(pid=83207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f155a74-3d73-4a49-a2b2-e8ade45d4942]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:19 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-530cd063-5453-4bd8-ad9b-ad682f847eaa req-2c8b04c1-af75-488a-b7ac-38b50203ff89 tempest-TestMinimumBasicScenario-600811562 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501" returned: 0 in 0.727s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:19 devstack cinder-volume[83207]: DEBUG cinder.utils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-532a40cb-6ee7-47ac-a521-f37d548b6d00 not found in is_blk_device check {{(pid=83207) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 17 07:54:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-532a40cb-6ee7-47ac-a521-f37d548b6d00 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:19 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-530cd063-5453-4bd8-ad9b-ad682f847eaa req-2c8b04c1-af75-488a-b7ac-38b50203ff89 tempest-TestMinimumBasicScenario-600811562 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:19 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=95, name=volume-532a40cb-6ee7-47ac-a521-f37d548b6d00, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:54:19 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-530cd063-5453-4bd8-ad9b-ad682f847eaa req-2c8b04c1-af75-488a-b7ac-38b50203ff89 tempest-TestMinimumBasicScenario-600811562 None] Terminate volume connection completed successfully. Sep 17 07:54:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-530cd063-5453-4bd8-ad9b-ad682f847eaa req-2c8b04c1-af75-488a-b7ac-38b50203ff89 tempest-TestMinimumBasicScenario-600811562 None] Deleting attachment 9c59131e-2a4f-4438-bf10-610e2d5feb74. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:54:23 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Acquiring lock "cinder-790e2d02-7813-4006-99da-099c7a47a07e-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:54:23 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Lock "cinder-790e2d02-7813-4006-99da-099c7a47a07e-delete_volume" acquired by "delete_volume" :: waited 0.215s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:54:24 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Acquiring lock "cinder-quobyte-790e2d02-7813-4006-99da-099c7a47a07e" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:54:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Lock "cinder-quobyte-790e2d02-7813-4006-99da-099c7a47a07e" acquired by "delete_volume" :: waited 0.053s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:54:24 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[af847cc2-cddb-489e-a388-00263268a24e]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-790e2d02-7813-4006-99da-099c7a47a07e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:26 devstack quobyte-client[83219]: System call of process 97568 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:54:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-790e2d02-7813-4006-99da-099c7a47a07e" returned: 0 in 2.229s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-790e2d02-7813-4006-99da-099c7a47a07e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-532a40cb-6ee7-47ac-a521-f37d548b6d00" returned: 0 in 7.495s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-790e2d02-7813-4006-99da-099c7a47a07e" returned: 0 in 0.292s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:26 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[172152f3-e2ba-42ea-b016-8a4dcadeb4ce]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Lock "cinder-quobyte-790e2d02-7813-4006-99da-099c7a47a07e" released by "delete_volume" :: held 2.914s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Created reservations ['ece48afc-1145-4382-a4f7-72ef268e63ed', 'f1cea9ad-a465-4d74-acd9-069f99fea578', '5f2e0f4f-8241-4578-8c70-e7faa5639a20', 'a8f67d60-10b2-463d-a920-7eda2d768c14'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501" returned: 0 in 0.739s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.132s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Image conversion details: src /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501, size 1024.00 MB, duration 7.53 sec, destination /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-532a40cb-6ee7-47ac-a521-f37d548b6d00 {{(pid=83207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 07:54:27 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Converted 1024.00 MB image at 136.00 MB/s Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-532a40cb-6ee7-47ac-a521-f37d548b6d00 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-532a40cb-6ee7-47ac-a521-f37d548b6d00 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:54:27 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Deleted volume successfully. Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-532a40cb-6ee7-47ac-a521-f37d548b6d00" returned: 0 in 0.405s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-532a40cb-6ee7-47ac-a521-f37d548b6d00" released by "_copy_volume_from_snapshot" :: held 10.159s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:54:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.248s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:54:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-d5f3700c-d64a-4d36-be4e-239b41056507-532a40cb-6ee7-47ac-a521-f37d548b6d00" released by "_create_volume_from_snapshot" :: held 10.247s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:54:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.278s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c3e37667-2a92-416e-8884-f4bb378a59aa tempest-TestMinimumBasicScenario-600811562 None] Lock "cinder-790e2d02-7813-4006-99da-099c7a47a07e-delete_volume" released by "delete_volume" :: held 4.758s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:54:28 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e7423e25-7e7a-4269-8c51-5ba36bd894fe tempest-GroupSnapshotsTest-1568143229 None] Create group from source-snapshot-8f335617-45c0-44df-abf2-21fb3380844f completed successfully. Sep 17 07:54:29 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-532a40cb-6ee7-47ac-a521-f37d548b6d00" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:54:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-532a40cb-6ee7-47ac-a521-f37d548b6d00" acquired by "delete_volume" :: waited 0.019s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:54:29 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e206845a-e588-463e-94b5-d5f5138776ff]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-532a40cb-6ee7-47ac-a521-f37d548b6d00 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-532a40cb-6ee7-47ac-a521-f37d548b6d00" returned: 0 in 0.470s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-532a40cb-6ee7-47ac-a521-f37d548b6d00 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-532a40cb-6ee7-47ac-a521-f37d548b6d00" returned: 0 in 0.098s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-532a40cb-6ee7-47ac-a521-f37d548b6d00" released by "delete_volume" :: held 0.762s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:54:31 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Created reservations ['21b488bb-df9b-4b48-8405-f5a302dcef0d'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:54:31 devstack cinder-volume[83207]: WARNING cinder.quota [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1121742845 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1121742845, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:54:31 devstack cinder-volume[83207]: WARNING cinder.quota [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1121742845 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1121742845, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:54:31 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Created reservations ['b34e8d91-0e76-4d0d-a0b0-5065919d1711', '39eb7988-bff4-41f7-9729-11a12f30217d', 'e8621dfe-f9ad-489f-b916-2606c1adabbd', '33f5f3b9-0a37-4a57-b06c-41517365ea4a'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:54:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:54:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:54:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.202s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:31 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:54:31 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4f845b3f-af88-4dcc-930d-42fd5b09a36e tempest-GroupSnapshotsTest-1568143229 None] Delete group completed successfully. Sep 17 07:54:32 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] group_snapshot 8f335617-45c0-44df-abf2-21fb3380844f: deleting Sep 17 07:54:32 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:32 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] group_snapshot 8f335617-45c0-44df-abf2-21fb3380844f: deleting {{(pid=83207) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 17 07:54:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-0e23f0f3-107c-4c54-aaa1-b2c406376501" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:54:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-0e23f0f3-107c-4c54-aaa1-b2c406376501" acquired by "delete_snapshot" :: waited 0.060s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:54:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-d5f3700c-d64a-4d36-be4e-239b41056507" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:54:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-d5f3700c-d64a-4d36-be4e-239b41056507" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:54:32 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Deleting offline snapshot d5f3700c-d64a-4d36-be4e-239b41056507 of volume 0e23f0f3-107c-4c54-aaa1-b2c406376501 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:54:32 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] snapshot_file for this snap is: volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:54:32 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[748e9e3c-1bd2-4b36-b427-beea2d062c76]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507" returned: 0 in 0.569s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:33 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e23f0f3-107c-4c54-aaa1-b2c406376501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:54:33 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94ce106-3bc8-4504-93ca-fb138a1570b9]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501" returned: 0 in 0.437s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507" returned: 0 in 0.231s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501.d5f3700c-d64a-4d36-be4e-239b41056507" returned: 0 in 0.099s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:34 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-d5f3700c-d64a-4d36-be4e-239b41056507" released by "_delete_snapshot" :: held 1.655s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:54:34 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-0e23f0f3-107c-4c54-aaa1-b2c406376501" released by "delete_snapshot" :: held 1.695s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:54:34 devstack cinder-volume[83207]: WARNING cinder.quota [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1121742845 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1121742845, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:54:34 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] Created reservations ['91416111-05a4-4ae0-b5c1-fec5186b701a', 'ba873652-6258-48bb-8c3f-b46be6c5625e', '1c918fc3-3845-4d49-bdd8-c7202c25cdf1', 'a7c36ab5-d9cc-4263-b28d-1f50f73b5d34'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:54:35 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b313737d-b651-4c95-adc9-7c03d68b3861 tempest-GroupSnapshotsTest-1568143229 None] group_snapshot 8f335617-45c0-44df-abf2-21fb3380844f: deleted successfully Sep 17 07:54:36 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-0e23f0f3-107c-4c54-aaa1-b2c406376501" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:54:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-0e23f0f3-107c-4c54-aaa1-b2c406376501" acquired by "delete_volume" :: waited 0.023s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:54:36 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7814ac69-07f7-4ff4-96b0-82cc3cc60820]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501" returned: 0 in 0.457s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0e23f0f3-107c-4c54-aaa1-b2c406376501" returned: 0 in 0.123s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:36 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-0e23f0f3-107c-4c54-aaa1-b2c406376501" released by "delete_volume" :: held 0.751s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:54:37 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Created reservations ['47d09dde-0964-4561-a59b-3dbd7279f430'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:54:37 devstack cinder-volume[83207]: WARNING cinder.db.sqlalchemy.api [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1121742845'] Sep 17 07:54:37 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Created reservations ['5733f127-9393-47bd-a8cd-a0f6da22e1af', '5c061b3a-81c6-4e10-a7b9-b137cb746acc', '5cdf292f-77f1-4830-9f13-bafbf3307cc7', '8718456c-0f2c-4241-8283-286ba5483168'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:54:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:54:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:54:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.077s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:37 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:54:37 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-114ee06e-c5ac-4978-a6f8-3bb2fd8feec1 tempest-GroupSnapshotsTest-1568143229 None] Delete group completed successfully. Sep 17 07:54:39 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-908cd2b5-ed98-45e9-adf0-4b1fdeb3b789 tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:39 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-908cd2b5-ed98-45e9-adf0-4b1fdeb3b789 tempest-GroupSnapshotsTest-1568143229 None] Group tempest-GroupSnapshotsTest-Group-302247806: creating Sep 17 07:54:39 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-908cd2b5-ed98-45e9-adf0-4b1fdeb3b789 tempest-GroupSnapshotsTest-1568143229 None] Group tempest-GroupSnapshotsTest-Group-302247806: created successfully Sep 17 07:54:39 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-908cd2b5-ed98-45e9-adf0-4b1fdeb3b789 tempest-GroupSnapshotsTest-1568143229 None] Create group completed successfully. Sep 17 07:54:40 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:40 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:54:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Flow 'volume_create_manager' (79bc12eb-3d19-4e9e-96a9-c6218597763c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:54:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758e12a4-5874-4017-bf22-14984a189037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758e12a4-5874-4017-bf22-14984a189037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-12866651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea2f4ea0-78ec-4a52-8093-6e1f643808e1,host='devstack@QuobyteHD#QuobyteHD',id=a7ccb618-2f9b-452f-8c60-739c46f28153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='002aa0e38a004ac89e5d0152575e0dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:54:41Z,use_quota=True,user_id='08a6a01abe9d4c629aa6d3aa32b612a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abd0947f-38dd-4fbb-8516-707fda8ffb65),volume_type_id=abd0947f-38dd-4fbb-8516-707fda8ffb65)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951607cb-6886-4e3a-8ac0-418e9eb9e576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951607cb-6886-4e3a-8ac0-418e9eb9e576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9b20a9-f6ff-4f37-a4a6-4125836487b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9b20a9-f6ff-4f37-a4a6-4125836487b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ccb618-2f9b-452f-8c60-739c46f28153', 'volume_name': 'volume-a7ccb618-2f9b-452f-8c60-739c46f28153', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a41f239-1bda-4bf5-98bd-edcf7fb02346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a41f239-1bda-4bf5-98bd-edcf7fb02346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628b471a-ccc2-4182-bf32-3776317ea389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:41 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Volume a7ccb618-2f9b-452f-8c60-739c46f28153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ccb618-2f9b-452f-8c60-739c46f28153', 'volume_size': 1} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ea2f4ea0-78ec-4a52-8093-6e1f643808e1,created_at=2025-09-17T05:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-12866651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea2f4ea0-78ec-4a52-8093-6e1f643808e1,host='devstack@QuobyteHD#QuobyteHD',id=a7ccb618-2f9b-452f-8c60-739c46f28153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='002aa0e38a004ac89e5d0152575e0dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:54:41Z,use_quota=True,user_id='08a6a01abe9d4c629aa6d3aa32b612a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abd0947f-38dd-4fbb-8516-707fda8ffb65),volume_type_id=abd0947f-38dd-4fbb-8516-707fda8ffb65)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Creating volume a7ccb618-2f9b-452f-8c60-739c46f28153 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:54:41 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:41 devstack quobyte-client[83219]: System call of process 97651 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:54:41 devstack quobyte-client[83219]: System call of process 97651 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:54:41 devstack quobyte-client[83219]: System call of process 97651 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:54:41 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=96, name=volume-a7ccb618-2f9b-452f-8c60-739c46f28153, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153 1073741824" returned: 0 in 0.461s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153" returned: 0 in 0.185s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] <== create_volume: return (741ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:54:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628b471a-ccc2-4182-bf32-3776317ea389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ccb618-2f9b-452f-8c60-739c46f28153', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a802023-2625-4257-af16-bdae923b16b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:42 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Volume volume-a7ccb618-2f9b-452f-8c60-739c46f28153 (a7ccb618-2f9b-452f-8c60-739c46f28153): created successfully Sep 17 07:54:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a802023-2625-4257-af16-bdae923b16b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Flow 'volume_create_manager' (79bc12eb-3d19-4e9e-96a9-c6218597763c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:54:42 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4887c5d5-6f4d-4621-8961-ce7b1148e311 tempest-GroupSnapshotsTest-1568143229 None] Created volume successfully. Sep 17 07:54:43 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Flow 'volume_create_manager' (a4999ad2-9026-46b5-9b39-8e0b9b6903ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f603f1b2-0134-4507-bbb8-e75dbd70f241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f603f1b2-0134-4507-bbb8-e75dbd70f241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1621700065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea2f4ea0-78ec-4a52-8093-6e1f643808e1,host='devstack@QuobyteHD#QuobyteHD',id=e07deb76-28c9-4720-a560-ad12a279a5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='002aa0e38a004ac89e5d0152575e0dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:54:43Z,use_quota=True,user_id='08a6a01abe9d4c629aa6d3aa32b612a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abd0947f-38dd-4fbb-8516-707fda8ffb65),volume_type_id=abd0947f-38dd-4fbb-8516-707fda8ffb65)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d01901d-281d-422f-ab2d-42cd4f24a8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d01901d-281d-422f-ab2d-42cd4f24a8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16063ce6-e5b8-41d3-8e38-a822fdfa4632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16063ce6-e5b8-41d3-8e38-a822fdfa4632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e07deb76-28c9-4720-a560-ad12a279a5c6', 'volume_name': 'volume-e07deb76-28c9-4720-a560-ad12a279a5c6', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f338a6e5-e0e5-4071-94a3-63dc649f2f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f338a6e5-e0e5-4071-94a3-63dc649f2f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958a6acd-2224-42d1-b80f-73cd6d6436e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:43 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Volume e07deb76-28c9-4720-a560-ad12a279a5c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e07deb76-28c9-4720-a560-ad12a279a5c6', 'volume_size': 1} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ea2f4ea0-78ec-4a52-8093-6e1f643808e1,created_at=2025-09-17T05:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1621700065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ea2f4ea0-78ec-4a52-8093-6e1f643808e1,host='devstack@QuobyteHD#QuobyteHD',id=e07deb76-28c9-4720-a560-ad12a279a5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='002aa0e38a004ac89e5d0152575e0dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:54:43Z,use_quota=True,user_id='08a6a01abe9d4c629aa6d3aa32b612a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abd0947f-38dd-4fbb-8516-707fda8ffb65),volume_type_id=abd0947f-38dd-4fbb-8516-707fda8ffb65)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Creating volume e07deb76-28c9-4720-a560-ad12a279a5c6 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:54:43 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:54:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:43 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=97, name=volume-e07deb76-28c9-4720-a560-ad12a279a5c6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:54:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6 1073741824" returned: 0 in 0.389s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6" returned: 0 in 0.131s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:44 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] <== create_volume: return (599ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:54:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.609s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958a6acd-2224-42d1-b80f-73cd6d6436e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e07deb76-28c9-4720-a560-ad12a279a5c6', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff31133-e397-48d9-bfdf-9cf02c9a3da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:54:44 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Volume volume-e07deb76-28c9-4720-a560-ad12a279a5c6 (e07deb76-28c9-4720-a560-ad12a279a5c6): created successfully Sep 17 07:54:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff31133-e397-48d9-bfdf-9cf02c9a3da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:54:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Flow 'volume_create_manager' (a4999ad2-9026-46b5-9b39-8e0b9b6903ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:54:44 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-35bcda11-b3a5-4125-97b8-55627466c8bd tempest-GroupSnapshotsTest-1568143229 None] Created volume successfully. Sep 17 07:54:46 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-8b6a6ca0-e29c-4bbb-b9d5-05fabd919804 tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:46 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-8b6a6ca0-e29c-4bbb-b9d5-05fabd919804 tempest-GroupSnapshotsTest-1568143229 None] Update group completed successfully. Sep 17 07:54:47 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-109a4dc4-3845-4276-962d-43e40d7167c3 tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:47 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-109a4dc4-3845-4276-962d-43e40d7167c3 tempest-GroupSnapshotsTest-1568143229 None] Update group completed successfully. Sep 17 07:54:48 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b07bf625-da13-43e1-9dde-63a53a26a1c4 tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:48 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b07bf625-da13-43e1-9dde-63a53a26a1c4 tempest-GroupSnapshotsTest-1568143229 None] Update group completed successfully. Sep 17 07:54:49 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-dffb8837-3cfd-45bd-a948-df69c56b592a tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:49 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-dffb8837-3cfd-45bd-a948-df69c56b592a tempest-GroupSnapshotsTest-1568143229 None] Update group completed successfully. Sep 17 07:54:51 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] GroupSnapshot 7f14b2d3-81ac-42a3-b1cc-66d38a60357b: creating. Sep 17 07:54:51 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Group snapshot 7f14b2d3-81ac-42a3-b1cc-66d38a60357b: creating. {{(pid=83207) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 17 07:54:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:51 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Creating offline snapshot 27f21c00-6259-4708-944d-bcdf6c701cfe of volume e07deb76-28c9-4720-a560-ad12a279a5c6 {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:54:51 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[887b8ffe-5f7d-4bd5-af52-2edafbc73a97]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6" returned: 0 in 0.452s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:52 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=98, name=volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:54:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe 1G" returned: 0 in 0.298s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e07deb76-28c9-4720-a560-ad12a279a5c6 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img rebase -u -b volume-e07deb76-28c9-4720-a560-ad12a279a5c6 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe" returned: 0 in 0.162s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:54:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe" returned: 0 in 0.130s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6 -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:54:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe" returned: 0 in 0.107s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.info" returned: 0 in 0.099s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:54:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.info" returned: 0 in 0.093s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.674s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:54:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:54:53 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Creating offline snapshot e75d407b-8b7c-4b6b-97fa-d3b45ff0b232 of volume a7ccb618-2f9b-452f-8c60-739c46f28153 {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:54:53 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a52c29-ce05-483a-a62e-914a21a80bd8]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153" returned: 0 in 0.488s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:53 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=100, name=volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232 1G" returned: 0 in 0.244s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a7ccb618-2f9b-452f-8c60-739c46f28153 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img rebase -u -b volume-a7ccb618-2f9b-452f-8c60-739c46f28153 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232" returned: 0 in 0.187s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232" returned: 0 in 0.088s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153 -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232" returned: 0 in 0.107s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.info" returned: 0 in 0.101s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.info" returned: 0 in 0.088s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:54:55 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-47579a13-588d-4a6b-b145-c2b2c423ae5b tempest-GroupSnapshotsTest-1568143229 None] group_snapshot 7f14b2d3-81ac-42a3-b1cc-66d38a60357b: created successfully Sep 17 07:54:55 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] group_snapshot 7f14b2d3-81ac-42a3-b1cc-66d38a60357b: deleting Sep 17 07:54:55 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:54:55 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] group_snapshot 7f14b2d3-81ac-42a3-b1cc-66d38a60357b: deleting {{(pid=83207) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 17 07:54:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-e07deb76-28c9-4720-a560-ad12a279a5c6" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:54:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-e07deb76-28c9-4720-a560-ad12a279a5c6" acquired by "delete_snapshot" :: waited 0.077s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:54:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-27f21c00-6259-4708-944d-bcdf6c701cfe" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:54:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-27f21c00-6259-4708-944d-bcdf6c701cfe" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:54:55 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Deleting offline snapshot 27f21c00-6259-4708-944d-bcdf6c701cfe of volume e07deb76-28c9-4720-a560-ad12a279a5c6 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:54:55 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] snapshot_file for this snap is: volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:54:55 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3946d15a-985f-4ba8-b158-82e7d6a83127]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe" returned: 0 in 0.436s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e07deb76-28c9-4720-a560-ad12a279a5c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:54:56 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e886e64b-ad15-4de4-982b-64a9b9e22fc1]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6" returned: 0 in 0.502s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe" returned: 0 in 0.184s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6.27f21c00-6259-4708-944d-bcdf6c701cfe" returned: 0 in 0.089s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-27f21c00-6259-4708-944d-bcdf6c701cfe" released by "_delete_snapshot" :: held 1.540s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-e07deb76-28c9-4720-a560-ad12a279a5c6" released by "delete_snapshot" :: held 1.575s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-a7ccb618-2f9b-452f-8c60-739c46f28153" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-a7ccb618-2f9b-452f-8c60-739c46f28153" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-e75d407b-8b7c-4b6b-97fa-d3b45ff0b232" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-e75d407b-8b7c-4b6b-97fa-d3b45ff0b232" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Deleting offline snapshot e75d407b-8b7c-4b6b-97fa-d3b45ff0b232 of volume a7ccb618-2f9b-452f-8c60-739c46f28153 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] snapshot_file for this snap is: volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ec8d23-85ac-4672-a188-9f11a83bdbd6]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232" returned: 0 in 0.451s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ccb618-2f9b-452f-8c60-739c46f28153(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:54:58 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d35cdb-e63f-494c-9111-63a573b271e1]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:54:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153" returned: 0 in 0.474s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:58 devstack quobyte-client[83219]: System call of process 97707 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:54:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232" returned: 0 in 0.205s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:54:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153.e75d407b-8b7c-4b6b-97fa-d3b45ff0b232" returned: 0 in 0.125s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:54:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-e75d407b-8b7c-4b6b-97fa-d3b45ff0b232" released by "_delete_snapshot" :: held 1.588s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:54:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-a7ccb618-2f9b-452f-8c60-739c46f28153" released by "delete_snapshot" :: held 1.608s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:54:59 devstack cinder-volume[83207]: WARNING cinder.quota [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-361330915 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-361330915, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:54:59 devstack cinder-volume[83207]: WARNING cinder.quota [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-361330915 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-361330915, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:54:59 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Created reservations ['f48536f4-388f-488a-b315-4c0a76523678', 'c71ff893-8e0a-4bcd-9389-7ee7bd20bd6d', 'fc9c19c3-b2d4-4377-b046-2892def8bf48', 'e8fac7f6-5c6f-469f-b70c-39efb18e9fcd'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:55:00 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] Created reservations ['362992ee-c926-49ce-862e-e2e35e05a518', '685adca6-ad4e-4016-8a41-7ab8322aa5aa', '7ec6b396-f014-443e-8c98-8cde0cd70cfe', '7e277cb4-cd29-455a-b4b5-e183c89c3478'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:55:00 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c7464561-2908-422d-80ba-4f91c3e998f8 tempest-GroupSnapshotsTest-1568143229 None] group_snapshot 7f14b2d3-81ac-42a3-b1cc-66d38a60357b: deleted successfully Sep 17 07:55:00 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-a7ccb618-2f9b-452f-8c60-739c46f28153" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:55:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-a7ccb618-2f9b-452f-8c60-739c46f28153" acquired by "delete_volume" :: waited 0.029s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:55:00 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e39c5c8-350b-4094-829c-b468ddec4f17]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:55:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153" returned: 0 in 0.831s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a7ccb618-2f9b-452f-8c60-739c46f28153" returned: 0 in 0.237s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-a7ccb618-2f9b-452f-8c60-739c46f28153" released by "delete_volume" :: held 1.293s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:55:02 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-e07deb76-28c9-4720-a560-ad12a279a5c6" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:55:02 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-e07deb76-28c9-4720-a560-ad12a279a5c6" acquired by "delete_volume" :: waited 0.063s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:55:02 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[707775f3-daaf-4a10-85ac-768bfcba506f]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:55:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6" returned: 0 in 0.910s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e07deb76-28c9-4720-a560-ad12a279a5c6" returned: 0 in 0.121s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:03 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-e07deb76-28c9-4720-a560-ad12a279a5c6" released by "delete_volume" :: held 1.342s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:55:03 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Created reservations ['9d889607-7a82-4888-a297-8af14f517038'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:55:03 devstack cinder-volume[83207]: WARNING cinder.quota [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-361330915 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-361330915, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:55:03 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Created reservations ['4b9d7ed8-6edf-4e0c-bfe0-8d9b15385687', '94134e15-8449-4915-a1e6-cb6c1c81377a', '0b436a6e-9f59-40a8-b161-3a7e5ddc3427', '755898d1-e7f5-457e-ac17-7195a2162cdf'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:55:04 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Created reservations ['3417326c-d2ed-40e4-b807-45fbdc611630', '36be8851-8a3a-4df7-afe3-6382ef73ed38', '04db2027-55ff-4735-bc3b-db1d2f1b5f60', '232633ab-51b2-4844-a5b2-b8303fd70e73'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:55:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:04 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:55:04 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:55:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.116s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:04 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:55:04 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d9a92873-21da-4213-878a-0ae10808b66b tempest-GroupSnapshotsTest-1568143229 None] Delete group completed successfully. Sep 17 07:55:06 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-d7be064d-ab11-4055-877e-6c1663e81f89 tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:06 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d7be064d-ab11-4055-877e-6c1663e81f89 tempest-GroupSnapshotsTest-1568143229 None] Group tempest-GroupSnapshotsTest-Group-1497300689: creating Sep 17 07:55:06 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d7be064d-ab11-4055-877e-6c1663e81f89 tempest-GroupSnapshotsTest-1568143229 None] Group tempest-GroupSnapshotsTest-Group-1497300689: created successfully Sep 17 07:55:06 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d7be064d-ab11-4055-877e-6c1663e81f89 tempest-GroupSnapshotsTest-1568143229 None] Create group completed successfully. Sep 17 07:55:08 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Flow 'volume_create_manager' (4e4d9d1f-b9b3-47a2-8e54-1dffadea5483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b081ef7-26f4-43cb-915f-6f5f7d374cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b081ef7-26f4-43cb-915f-6f5f7d374cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-264992650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=497b251b-7c86-49d4-aec3-f78fcc443b95,host='devstack@QuobyteHD#QuobyteHD',id=3d553617-4317-4fff-8bec-35a28bdd761b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='002aa0e38a004ac89e5d0152575e0dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:55:08Z,use_quota=True,user_id='08a6a01abe9d4c629aa6d3aa32b612a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(769ebd5d-6522-449b-a844-281b47b500f2),volume_type_id=769ebd5d-6522-449b-a844-281b47b500f2)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca788cb-da1e-49db-884f-c80b0d040842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca788cb-da1e-49db-884f-c80b0d040842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88c44d7-8bd2-445e-9a0e-4efd61a835b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88c44d7-8bd2-445e-9a0e-4efd61a835b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d553617-4317-4fff-8bec-35a28bdd761b', 'volume_name': 'volume-3d553617-4317-4fff-8bec-35a28bdd761b', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9493d422-22fd-4702-b773-64f46aaa7a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9493d422-22fd-4702-b773-64f46aaa7a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda14523-ef39-4268-8fd6-5f993890e657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:08 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Volume 3d553617-4317-4fff-8bec-35a28bdd761b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d553617-4317-4fff-8bec-35a28bdd761b', 'volume_size': 1} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=497b251b-7c86-49d4-aec3-f78fcc443b95,created_at=2025-09-17T05:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-264992650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=497b251b-7c86-49d4-aec3-f78fcc443b95,host='devstack@QuobyteHD#QuobyteHD',id=3d553617-4317-4fff-8bec-35a28bdd761b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='002aa0e38a004ac89e5d0152575e0dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:55:08Z,use_quota=True,user_id='08a6a01abe9d4c629aa6d3aa32b612a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(769ebd5d-6522-449b-a844-281b47b500f2),volume_type_id=769ebd5d-6522-449b-a844-281b47b500f2)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Creating volume 3d553617-4317-4fff-8bec-35a28bdd761b {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:55:08 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:55:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:08 devstack quobyte-client[83219]: System call of process 97865 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:55:08 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=102, name=volume-3d553617-4317-4fff-8bec-35a28bdd761b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:55:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b 1073741824" returned: 0 in 0.380s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b" returned: 0 in 0.166s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] <== create_volume: return (650ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:55:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda14523-ef39-4268-8fd6-5f993890e657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d553617-4317-4fff-8bec-35a28bdd761b', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442eaa64-efc5-458d-8f38-eed9f2b896cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:09 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Volume volume-3d553617-4317-4fff-8bec-35a28bdd761b (3d553617-4317-4fff-8bec-35a28bdd761b): created successfully Sep 17 07:55:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442eaa64-efc5-458d-8f38-eed9f2b896cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Flow 'volume_create_manager' (4e4d9d1f-b9b3-47a2-8e54-1dffadea5483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:55:09 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-beac1d15-5976-42af-b7b1-094e8109616d tempest-GroupSnapshotsTest-1568143229 None] Created volume successfully. Sep 17 07:55:10 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] GroupSnapshot 605592d7-7288-4df5-846a-cb6fe82bd18d: creating. Sep 17 07:55:10 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=81,cinder:SELECT=91,cinder:INSERT=14,cinder:DELETE=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:55:10 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=90,cinder:UPDATE=92,cinder:DELETE=3,cinder:INSERT=21 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:55:10 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] Group snapshot 605592d7-7288-4df5-846a-cb6fe82bd18d: creating. {{(pid=83207) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 17 07:55:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:11 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] Creating offline snapshot 1d1f170a-747a-4a09-beb8-42958b82a32f of volume 3d553617-4317-4fff-8bec-35a28bdd761b {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 07:55:11 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32ac25e-56f3-45d8-abc9-27920b5614b4]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:55:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b" returned: 0 in 0.529s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:11 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=103, name=volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:55:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f 1G" returned: 0 in 0.266s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3d553617-4317-4fff-8bec-35a28bdd761b -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img rebase -u -b volume-3d553617-4317-4fff-8bec-35a28bdd761b -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f" returned: 0 in 0.163s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:55:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f" returned: 0 in 0.100s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 07:55:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f" returned: 0 in 0.131s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.info" returned: 0 in 0.117s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 07:55:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.info" returned: 0 in 0.135s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:13 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-053307e7-83bf-456f-9672-56a056aad4f2 tempest-GroupSnapshotsTest-1568143229 None] group_snapshot 605592d7-7288-4df5-846a-cb6fe82bd18d: created successfully Sep 17 07:55:14 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] group_snapshot 605592d7-7288-4df5-846a-cb6fe82bd18d: deleting Sep 17 07:55:14 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] group_snapshot 605592d7-7288-4df5-846a-cb6fe82bd18d: deleting {{(pid=83207) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 17 07:55:14 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-3d553617-4317-4fff-8bec-35a28bdd761b" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:55:14 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-3d553617-4317-4fff-8bec-35a28bdd761b" acquired by "delete_snapshot" :: waited 0.066s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:55:14 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-1d1f170a-747a-4a09-beb8-42958b82a32f" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:55:14 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-1d1f170a-747a-4a09-beb8-42958b82a32f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:55:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Deleting offline snapshot 1d1f170a-747a-4a09-beb8-42958b82a32f of volume 3d553617-4317-4fff-8bec-35a28bdd761b {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 07:55:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] snapshot_file for this snap is: volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 07:55:14 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e881910-3ad2-42ad-b68a-3fde64b7d92b]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:55:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f" returned: 0 in 0.422s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d553617-4317-4fff-8bec-35a28bdd761b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 07:55:15 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b173e212-d476-4d05-9849-94a1a692c7c6]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:55:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b" returned: 0 in 0.531s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f" returned: 0 in 0.217s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b.1d1f170a-747a-4a09-beb8-42958b82a32f" returned: 0 in 0.111s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:16 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-1d1f170a-747a-4a09-beb8-42958b82a32f" released by "_delete_snapshot" :: held 1.701s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:55:16 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-3d553617-4317-4fff-8bec-35a28bdd761b" released by "delete_snapshot" :: held 1.725s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:55:16 devstack cinder-volume[83207]: WARNING cinder.quota [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-460170048 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-460170048, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:55:16 devstack cinder-volume[83207]: WARNING cinder.quota [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-460170048 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-460170048, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:55:16 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] Created reservations ['b6324308-9abd-4715-a66d-0b32ed04c9e1', 'a9cdafbd-94cf-42c2-9e4e-51af7c30fab2', '5a0f8fac-38ff-4bb2-9be3-e6ee36712f0b', '34d5002e-9477-4fcb-8c01-63076d626ae1'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:55:16 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c538243d-dd72-4a0e-b6bc-eef7a7c88153 tempest-GroupSnapshotsTest-1568143229 None] group_snapshot 605592d7-7288-4df5-846a-cb6fe82bd18d: deleted successfully Sep 17 07:55:18 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "cinder-quobyte-3d553617-4317-4fff-8bec-35a28bdd761b" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:55:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-3d553617-4317-4fff-8bec-35a28bdd761b" acquired by "delete_volume" :: waited 0.014s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:55:18 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b69104-2a72-4d2b-831c-a93e382e86a0]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:55:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b" returned: 0 in 0.430s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3d553617-4317-4fff-8bec-35a28bdd761b" returned: 0 in 0.154s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Lock "cinder-quobyte-3d553617-4317-4fff-8bec-35a28bdd761b" released by "delete_volume" :: held 0.769s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:55:19 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Created reservations ['43c2248b-75df-47a2-ad87-7192f5f4fee2'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:55:19 devstack cinder-volume[83207]: WARNING cinder.quota [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-460170048 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-460170048, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:55:19 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Created reservations ['ca184b91-cbe2-46ec-adae-6d3b698f62c5', 'b69f09e1-ebc4-4d28-9e88-e8f37ba87cc5', '51e9a94a-3e47-43d5-83f7-306c163e9141', 'db9a7317-75ac-4cbd-b9c5-64dae1999ae1'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:55:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:19 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:55:19 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:55:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.118s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:19 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:55:19 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c77ba213-f73b-43ce-94fa-6a842f3c5dfe tempest-GroupSnapshotsTest-1568143229 None] Delete group completed successfully. Sep 17 07:55:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:55:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:55:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:55:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.155s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:55:29 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:INSERT=7 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:55:29 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=18,cinder:UPDATE=16,cinder:INSERT=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:55:33 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-c597ef2d-7da8-4a1b-9817-0b9297d57604 tempest-GroupsTest-63487857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:33 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c597ef2d-7da8-4a1b-9817-0b9297d57604 tempest-GroupsTest-63487857 None] Group tempest-Group1-732563175: creating Sep 17 07:55:34 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c597ef2d-7da8-4a1b-9817-0b9297d57604 tempest-GroupsTest-63487857 None] Group tempest-Group1-732563175: created successfully Sep 17 07:55:34 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c597ef2d-7da8-4a1b-9817-0b9297d57604 tempest-GroupsTest-63487857 None] Create group completed successfully. Sep 17 07:55:34 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-de4ae3ae-a50d-4200-9708-d3582afd775c tempest-GroupsTest-63487857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:35 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-de4ae3ae-a50d-4200-9708-d3582afd775c tempest-GroupsTest-63487857 None] Group tempest-Group2-413963952: creating Sep 17 07:55:35 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-de4ae3ae-a50d-4200-9708-d3582afd775c tempest-GroupsTest-63487857 None] Group tempest-Group2-413963952: created successfully Sep 17 07:55:35 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-de4ae3ae-a50d-4200-9708-d3582afd775c tempest-GroupsTest-63487857 None] Create group completed successfully. Sep 17 07:55:36 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Flow 'volume_create_manager' (3dad8fe5-49c8-4f44-b666-abbbd8fce062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b60c47-2677-4b17-957c-0a43cff99d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b60c47-2677-4b17-957c-0a43cff99d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-569484314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1aa4c5d2-9828-4897-a7dd-7f8c3693a4e7,host='devstack@QuobyteHD#QuobyteHD',id=0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b0c5a8df094cababa77dea3eb74568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:55:37Z,use_quota=True,user_id='5001108cc50d4afcb104176969aba134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78dfb1f8-e0f0-41fd-9e6b-00340e60fef9),volume_type_id=78dfb1f8-e0f0-41fd-9e6b-00340e60fef9)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a9216b-d983-44f2-baf1-ae46f4b1ed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a9216b-d983-44f2-baf1-ae46f4b1ed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95af1485-f296-4a16-aeeb-d658b21170c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95af1485-f296-4a16-aeeb-d658b21170c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4', 'volume_name': 'volume-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29641aba-7d94-486a-b573-59bc6aa0ed81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29641aba-7d94-486a-b573-59bc6aa0ed81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b29cc90-35bf-4edf-9a04-6f31ac1deb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:36 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Volume 0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4', 'volume_size': 1} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1aa4c5d2-9828-4897-a7dd-7f8c3693a4e7,created_at=2025-09-17T05:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-569484314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1aa4c5d2-9828-4897-a7dd-7f8c3693a4e7,host='devstack@QuobyteHD#QuobyteHD',id=0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b0c5a8df094cababa77dea3eb74568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:55:37Z,use_quota=True,user_id='5001108cc50d4afcb104176969aba134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78dfb1f8-e0f0-41fd-9e6b-00340e60fef9),volume_type_id=78dfb1f8-e0f0-41fd-9e6b-00340e60fef9)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Creating volume 0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:55:36 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:55:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:37 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=105, name=volume-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:55:37 devstack quobyte-client[83219]: System call of process 98035 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:55:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4 1073741824" returned: 0 in 0.350s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4" returned: 0 in 0.082s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] <== create_volume: return (503ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:55:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.518s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b29cc90-35bf-4edf-9a04-6f31ac1deb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e98ca348-df98-45d8-9e94-cfccb4959fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:37 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Volume volume-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4 (0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4): created successfully Sep 17 07:55:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e98ca348-df98-45d8-9e94-cfccb4959fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Flow 'volume_create_manager' (3dad8fe5-49c8-4f44-b666-abbbd8fce062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:55:37 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5bc611bc-af05-47fe-8759-3387fa2801e0 tempest-GroupsTest-63487857 None] Created volume successfully. Sep 17 07:55:39 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:39 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Acquiring lock "cinder-quobyte-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:55:39 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Lock "cinder-quobyte-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4" acquired by "delete_volume" :: waited 0.058s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:55:39 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[238cd8bf-f1d6-4472-94d5-46bc0d1dd0cb]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:55:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4" returned: 0 in 0.485s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4" returned: 0 in 0.119s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:40 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Lock "cinder-quobyte-0ec667c4-5ff5-4e7f-a712-2ab8450d2bc4" released by "delete_volume" :: held 0.865s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:55:40 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Created reservations ['6e7b0eea-0c3d-4fd4-9f34-24dcbd7b3e52'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:55:40 devstack cinder-volume[83207]: WARNING cinder.quota [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1084581766 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1084581766, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:55:40 devstack cinder-volume[83207]: WARNING cinder.quota [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1084581766 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1084581766, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:55:40 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Created reservations ['fdeaf063-c638-4828-94fb-52fca70c4d9d', 'e10c478a-fac0-4489-9c70-85d76f088989', 'dcf90d1c-9a57-4a81-8f55-7861ce45a5e5', '4d4605f7-aacb-4a1b-af75-e4422aa3b8a8'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:55:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:55:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:55:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.110s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:41 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:55:41 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-743d37c3-295e-449d-a866-9f1cd2ce9d47 tempest-GroupsTest-63487857 None] Delete group completed successfully. Sep 17 07:55:42 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-ea73014a-2aa1-4632-ae98-2378171a05ec tempest-GroupsTest-63487857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:42 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-ea73014a-2aa1-4632-ae98-2378171a05ec tempest-GroupsTest-63487857 None] Created reservations ['56c38113-9656-4553-9146-70f4afac4a15'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:55:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ea73014a-2aa1-4632-ae98-2378171a05ec tempest-GroupsTest-63487857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ea73014a-2aa1-4632-ae98-2378171a05ec tempest-GroupsTest-63487857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ea73014a-2aa1-4632-ae98-2378171a05ec tempest-GroupsTest-63487857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:55:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ea73014a-2aa1-4632-ae98-2378171a05ec tempest-GroupsTest-63487857 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:55:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ea73014a-2aa1-4632-ae98-2378171a05ec tempest-GroupsTest-63487857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ea73014a-2aa1-4632-ae98-2378171a05ec tempest-GroupsTest-63487857 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ea73014a-2aa1-4632-ae98-2378171a05ec tempest-GroupsTest-63487857 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.355s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:43 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-ea73014a-2aa1-4632-ae98-2378171a05ec tempest-GroupsTest-63487857 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:55:43 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ea73014a-2aa1-4632-ae98-2378171a05ec tempest-GroupsTest-63487857 None] Delete group completed successfully. Sep 17 07:55:45 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-3e70e13a-9600-495f-bdfb-e5c15b4e85c7 tempest-GroupsTest-63487857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:45 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-3e70e13a-9600-495f-bdfb-e5c15b4e85c7 tempest-GroupsTest-63487857 None] Group tempest-GroupsTest-Group-325393490: creating Sep 17 07:55:45 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-3e70e13a-9600-495f-bdfb-e5c15b4e85c7 tempest-GroupsTest-63487857 None] Group tempest-GroupsTest-Group-325393490: created successfully Sep 17 07:55:45 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-3e70e13a-9600-495f-bdfb-e5c15b4e85c7 tempest-GroupsTest-63487857 None] Create group completed successfully. Sep 17 07:55:47 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Flow 'volume_create_manager' (8bccdad3-ba69-4eb0-9125-4aee38c8c515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae663ad-7cd0-4413-9691-61f0a3c0ca84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ae663ad-7cd0-4413-9691-61f0a3c0ca84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1514509450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ea2fbd9-db19-402f-bc0e-2e45c30902b5,host='devstack@QuobyteHD#QuobyteHD',id=83541256-0118-4e0d-ad12-bc4f491e5f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b0c5a8df094cababa77dea3eb74568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:55:47Z,use_quota=True,user_id='5001108cc50d4afcb104176969aba134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2a09848-4613-4147-9301-9d5e73af4a7a),volume_type_id=b2a09848-4613-4147-9301-9d5e73af4a7a)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e53ed31-f4cd-40ad-9c3b-3e70b6fb74ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e53ed31-f4cd-40ad-9c3b-3e70b6fb74ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2f9ab3-1083-4367-aa3c-1a218198834a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2f9ab3-1083-4367-aa3c-1a218198834a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83541256-0118-4e0d-ad12-bc4f491e5f5c', 'volume_name': 'volume-83541256-0118-4e0d-ad12-bc4f491e5f5c', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9118f88b-645f-4040-aa9e-26cac287447d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9118f88b-645f-4040-aa9e-26cac287447d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea0af3c-2119-4357-956a-5a014379f3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:47 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Volume 83541256-0118-4e0d-ad12-bc4f491e5f5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83541256-0118-4e0d-ad12-bc4f491e5f5c', 'volume_size': 1} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7ea2fbd9-db19-402f-bc0e-2e45c30902b5,created_at=2025-09-17T05:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1514509450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ea2fbd9-db19-402f-bc0e-2e45c30902b5,host='devstack@QuobyteHD#QuobyteHD',id=83541256-0118-4e0d-ad12-bc4f491e5f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b0c5a8df094cababa77dea3eb74568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:55:47Z,use_quota=True,user_id='5001108cc50d4afcb104176969aba134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2a09848-4613-4147-9301-9d5e73af4a7a),volume_type_id=b2a09848-4613-4147-9301-9d5e73af4a7a)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Creating volume 83541256-0118-4e0d-ad12-bc4f491e5f5c {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:55:47 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-83541256-0118-4e0d-ad12-bc4f491e5f5c 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:47 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=106, name=volume-83541256-0118-4e0d-ad12-bc4f491e5f5c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-83541256-0118-4e0d-ad12-bc4f491e5f5c 1073741824" returned: 0 in 0.387s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-83541256-0118-4e0d-ad12-bc4f491e5f5c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-83541256-0118-4e0d-ad12-bc4f491e5f5c" returned: 0 in 0.176s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] <== create_volume: return (659ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:55:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea0af3c-2119-4357-956a-5a014379f3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83541256-0118-4e0d-ad12-bc4f491e5f5c', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0c79d2-aae8-43ef-a766-c0d4d23b2aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:48 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Volume volume-83541256-0118-4e0d-ad12-bc4f491e5f5c (83541256-0118-4e0d-ad12-bc4f491e5f5c): created successfully Sep 17 07:55:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0c79d2-aae8-43ef-a766-c0d4d23b2aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Flow 'volume_create_manager' (8bccdad3-ba69-4eb0-9125-4aee38c8c515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:55:48 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-790326be-e7a5-4eb5-8b71-6dcbc76c24bf tempest-GroupsTest-63487857 None] Created volume successfully. Sep 17 07:55:49 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:49 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:55:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Flow 'volume_create_manager' (2643fc1a-4f3b-4f89-b72c-ad9ff152a0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:55:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88581270-44db-4b5a-9fd9-bb0ffea5c41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88581270-44db-4b5a-9fd9-bb0ffea5c41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-609053718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ea2fbd9-db19-402f-bc0e-2e45c30902b5,host='devstack@QuobyteHD#QuobyteHD',id=379e6db7-3940-4df6-a966-26c21d1e3169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b0c5a8df094cababa77dea3eb74568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:55:50Z,use_quota=True,user_id='5001108cc50d4afcb104176969aba134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2a09848-4613-4147-9301-9d5e73af4a7a),volume_type_id=b2a09848-4613-4147-9301-9d5e73af4a7a)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72173842-6518-4093-b400-612f998fe3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72173842-6518-4093-b400-612f998fe3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb7f5b4-0922-4828-bf04-701816e7d478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffb7f5b4-0922-4828-bf04-701816e7d478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '379e6db7-3940-4df6-a966-26c21d1e3169', 'volume_name': 'volume-379e6db7-3940-4df6-a966-26c21d1e3169', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd97563-5ab5-4712-8d9f-bd5cfc0cdd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd97563-5ab5-4712-8d9f-bd5cfc0cdd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fafd9fe-e3b6-4741-b4de-3bbfa1dee3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:50 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Volume 379e6db7-3940-4df6-a966-26c21d1e3169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-379e6db7-3940-4df6-a966-26c21d1e3169', 'volume_size': 1} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7ea2fbd9-db19-402f-bc0e-2e45c30902b5,created_at=2025-09-17T05:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-609053718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ea2fbd9-db19-402f-bc0e-2e45c30902b5,host='devstack@QuobyteHD#QuobyteHD',id=379e6db7-3940-4df6-a966-26c21d1e3169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b0c5a8df094cababa77dea3eb74568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:55:50Z,use_quota=True,user_id='5001108cc50d4afcb104176969aba134',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2a09848-4613-4147-9301-9d5e73af4a7a),volume_type_id=b2a09848-4613-4147-9301-9d5e73af4a7a)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Creating volume 379e6db7-3940-4df6-a966-26c21d1e3169 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:55:50 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-379e6db7-3940-4df6-a966-26c21d1e3169 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:50 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=107, name=volume-379e6db7-3940-4df6-a966-26c21d1e3169, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-379e6db7-3940-4df6-a966-26c21d1e3169 1073741824" returned: 0 in 0.408s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-379e6db7-3940-4df6-a966-26c21d1e3169 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-379e6db7-3940-4df6-a966-26c21d1e3169" returned: 0 in 0.152s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] <== create_volume: return (634ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.648s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fafd9fe-e3b6-4741-b4de-3bbfa1dee3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379e6db7-3940-4df6-a966-26c21d1e3169', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:50 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2de664-2c25-400c-9468-73d3d158df6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:55:51 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Volume volume-379e6db7-3940-4df6-a966-26c21d1e3169 (379e6db7-3940-4df6-a966-26c21d1e3169): created successfully Sep 17 07:55:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2de664-2c25-400c-9468-73d3d158df6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:55:51 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Flow 'volume_create_manager' (2643fc1a-4f3b-4f89-b72c-ad9ff152a0df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:55:51 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ccaa8158-9b22-4075-9b11-9c084f6a061d tempest-GroupsTest-63487857 None] Created volume successfully. Sep 17 07:55:52 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-bc2d9b22-21a5-4e12-b89d-c96c7ef8a6c6 tempest-GroupsTest-63487857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:52 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-bc2d9b22-21a5-4e12-b89d-c96c7ef8a6c6 tempest-GroupsTest-63487857 None] Update group completed successfully. Sep 17 07:55:53 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-9d427f1f-3703-4a94-add4-ce50b69ccd55 tempest-GroupsTest-63487857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:53 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-9d427f1f-3703-4a94-add4-ce50b69ccd55 tempest-GroupsTest-63487857 None] Update group completed successfully. Sep 17 07:55:55 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:55:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Acquiring lock "cinder-quobyte-379e6db7-3940-4df6-a966-26c21d1e3169" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:55:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Lock "cinder-quobyte-379e6db7-3940-4df6-a966-26c21d1e3169" acquired by "delete_volume" :: waited 0.057s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:55:55 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6608818-9e60-48d5-b928-5ac2d2150b71]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:55:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-379e6db7-3940-4df6-a966-26c21d1e3169 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-379e6db7-3940-4df6-a966-26c21d1e3169" returned: 0 in 0.411s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-379e6db7-3940-4df6-a966-26c21d1e3169 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-379e6db7-3940-4df6-a966-26c21d1e3169" returned: 0 in 0.103s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Lock "cinder-quobyte-379e6db7-3940-4df6-a966-26c21d1e3169" released by "delete_volume" :: held 0.667s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:55:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Acquiring lock "cinder-quobyte-83541256-0118-4e0d-ad12-bc4f491e5f5c" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:55:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Lock "cinder-quobyte-83541256-0118-4e0d-ad12-bc4f491e5f5c" acquired by "delete_volume" :: waited 0.022s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:55:55 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[764feaac-241c-44d1-828c-5db5ed5b43e6]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:55:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-83541256-0118-4e0d-ad12-bc4f491e5f5c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-83541256-0118-4e0d-ad12-bc4f491e5f5c" returned: 0 in 0.616s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-83541256-0118-4e0d-ad12-bc4f491e5f5c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-83541256-0118-4e0d-ad12-bc4f491e5f5c" returned: 0 in 0.156s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Lock "cinder-quobyte-83541256-0118-4e0d-ad12-bc4f491e5f5c" released by "delete_volume" :: held 0.933s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:55:57 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Created reservations ['38b65714-cd23-4868-96c5-a78e12ce1807'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:55:57 devstack cinder-volume[83207]: WARNING cinder.quota [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1737551593 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1737551593, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:55:57 devstack cinder-volume[83207]: WARNING cinder.quota [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1737551593 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1737551593, it is now deprecated. Please use the default quota class for default quota. Sep 17 07:55:57 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Created reservations ['1890ef6d-0d51-424b-99fd-1d4524c286ee', '8c11d5f4-ae81-492c-ad0d-53116ff3e2cf', 'a12e0ec5-b612-4097-996a-5b0c27f5a3ee', '7b4127a4-9163-4997-b240-7a5e26a1558a'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:55:57 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Created reservations ['a8e5f784-190b-4126-b667-a01ba0eaacf4', '77a3bbf6-8dad-49a3-8d33-2ba31cc234a5', '2ab81e5c-0cb6-4080-bd5c-e82ba3b185a7', 'c93ce281-f3b0-4357-b05d-80eb9319fe95'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:55:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:55:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:55:57 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:55:57 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:55:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:55:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:55:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.086s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:55:57 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:55:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-0c7e8b2b-c795-43d0-b08d-47a3c8392dcd tempest-GroupsTest-63487857 None] Delete group completed successfully. Sep 17 07:56:04 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-6532bb72-b275-424a-9cec-27830fd91628 tempest-GroupsV320Test-1274428374 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:56:04 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-6532bb72-b275-424a-9cec-27830fd91628 tempest-GroupsV320Test-1274428374 None] Group tempest-GroupsV320Test-Group-26267532: creating Sep 17 07:56:04 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-6532bb72-b275-424a-9cec-27830fd91628 tempest-GroupsV320Test-1274428374 None] Group tempest-GroupsV320Test-Group-26267532: created successfully Sep 17 07:56:04 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-6532bb72-b275-424a-9cec-27830fd91628 tempest-GroupsV320Test-1274428374 None] Create group completed successfully. Sep 17 07:56:06 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-fee41afb-b454-4564-b4cb-46583cd9fbb2 tempest-GroupsV320Test-1274428374 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:56:06 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-fee41afb-b454-4564-b4cb-46583cd9fbb2 tempest-GroupsV320Test-1274428374 None] Created reservations ['650a91c9-6010-4303-9d82-69ceb54b3a75'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:56:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fee41afb-b454-4564-b4cb-46583cd9fbb2 tempest-GroupsV320Test-1274428374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fee41afb-b454-4564-b4cb-46583cd9fbb2 tempest-GroupsV320Test-1274428374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fee41afb-b454-4564-b4cb-46583cd9fbb2 tempest-GroupsV320Test-1274428374 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:56:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-fee41afb-b454-4564-b4cb-46583cd9fbb2 tempest-GroupsV320Test-1274428374 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:56:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-fee41afb-b454-4564-b4cb-46583cd9fbb2 tempest-GroupsV320Test-1274428374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-fee41afb-b454-4564-b4cb-46583cd9fbb2 tempest-GroupsV320Test-1274428374 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-fee41afb-b454-4564-b4cb-46583cd9fbb2 tempest-GroupsV320Test-1274428374 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.245s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:07 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-fee41afb-b454-4564-b4cb-46583cd9fbb2 tempest-GroupsV320Test-1274428374 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:56:07 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-fee41afb-b454-4564-b4cb-46583cd9fbb2 tempest-GroupsV320Test-1274428374 None] Delete group completed successfully. Sep 17 07:56:16 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=48,cinder:UPDATE=49,cinder:INSERT=12,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:56:16 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=46,cinder:UPDATE=44,cinder:DELETE=2,cinder:INSERT=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:56:27 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:56:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:56:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:56:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.100s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:56:36 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Flow 'volume_create_manager' (c125c350-c3ed-46bd-8700-1acadf804073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5b994e-ee2f-414b-9865-f2e1b3210010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5b994e-ee2f-414b-9865-f2e1b3210010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-200946839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2b6f00-817c-4471-adfd-48a202711c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5e7497d7c341848e1b82aed2fa9beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:36Z,use_quota=True,user_id='44f0c80764044807b2356312bea24c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c347cb55-5496-4be8-b30c-aaa6ae173ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c347cb55-5496-4be8-b30c-aaa6ae173ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb2667b-faf7-4c53-b1aa-581c1ae9011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb2667b-faf7-4c53-b1aa-581c1ae9011f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f2b6f00-817c-4471-adfd-48a202711c30', 'volume_name': 'volume-9f2b6f00-817c-4471-adfd-48a202711c30', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e012cb70-9f18-433c-ac4f-d5090cd76cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e012cb70-9f18-433c-ac4f-d5090cd76cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dc4847-6c2f-4d80-9ff0-c87183def300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:36 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Volume 9f2b6f00-817c-4471-adfd-48a202711c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f2b6f00-817c-4471-adfd-48a202711c30', 'volume_size': 1} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:56:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-200946839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2b6f00-817c-4471-adfd-48a202711c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5e7497d7c341848e1b82aed2fa9beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:36Z,use_quota=True,user_id='44f0c80764044807b2356312bea24c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Creating volume 9f2b6f00-817c-4471-adfd-48a202711c30 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:56:36 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:56:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9f2b6f00-817c-4471-adfd-48a202711c30 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:37 devstack quobyte-client[83219]: System call of process 98241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:56:37 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=108, name=volume-9f2b6f00-817c-4471-adfd-48a202711c30, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:56:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9f2b6f00-817c-4471-adfd-48a202711c30 1073741824" returned: 0 in 0.424s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9f2b6f00-817c-4471-adfd-48a202711c30 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9f2b6f00-817c-4471-adfd-48a202711c30" returned: 0 in 0.092s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] <== create_volume: return (608ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:56:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.621s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8dc4847-6c2f-4d80-9ff0-c87183def300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f2b6f00-817c-4471-adfd-48a202711c30', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af36a6cd-882c-4edc-88b9-4dff164bdf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:37 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Volume volume-9f2b6f00-817c-4471-adfd-48a202711c30 (9f2b6f00-817c-4471-adfd-48a202711c30): created successfully Sep 17 07:56:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af36a6cd-882c-4edc-88b9-4dff164bdf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Flow 'volume_create_manager' (c125c350-c3ed-46bd-8700-1acadf804073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:56:37 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4e285b41-dbcd-454c-8fea-7f05b05922db tempest-VolumesListAdminTestJSON-493452358 None] Created volume successfully. Sep 17 07:56:39 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Flow 'volume_create_manager' (6e58c55c-0937-4835-a668-b9401c088139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5ad844-903f-4de6-b565-25626d9ef824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5ad844-903f-4de6-b565-25626d9ef824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-785854274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5e970d-0b80-4842-b83a-ef1dcedf2517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5e7497d7c341848e1b82aed2fa9beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:39Z,use_quota=True,user_id='44f0c80764044807b2356312bea24c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e9e99f-388c-4ccd-97e3-9d3a2166dcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e9e99f-388c-4ccd-97e3-9d3a2166dcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6574cd5e-6535-4b0a-b51c-1bdf43fc4c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6574cd5e-6535-4b0a-b51c-1bdf43fc4c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e5e970d-0b80-4842-b83a-ef1dcedf2517', 'volume_name': 'volume-4e5e970d-0b80-4842-b83a-ef1dcedf2517', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0bc0e4-05a1-46d7-96b3-7586fe858481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0bc0e4-05a1-46d7-96b3-7586fe858481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdf54fa-4fa7-44d8-9d06-3b5579572897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:39 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Volume 4e5e970d-0b80-4842-b83a-ef1dcedf2517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e5e970d-0b80-4842-b83a-ef1dcedf2517', 'volume_size': 1} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-785854274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5e970d-0b80-4842-b83a-ef1dcedf2517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5e7497d7c341848e1b82aed2fa9beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:39Z,use_quota=True,user_id='44f0c80764044807b2356312bea24c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Creating volume 4e5e970d-0b80-4842-b83a-ef1dcedf2517 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:56:39 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4e5e970d-0b80-4842-b83a-ef1dcedf2517 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:39 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=109, name=volume-4e5e970d-0b80-4842-b83a-ef1dcedf2517, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4e5e970d-0b80-4842-b83a-ef1dcedf2517 1073741824" returned: 0 in 0.335s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4e5e970d-0b80-4842-b83a-ef1dcedf2517 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4e5e970d-0b80-4842-b83a-ef1dcedf2517" returned: 0 in 0.099s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] <== create_volume: return (534ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:56:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.546s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cdf54fa-4fa7-44d8-9d06-3b5579572897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5e970d-0b80-4842-b83a-ef1dcedf2517', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4732ed3-bebf-497f-a44a-a324650443c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:40 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Volume volume-4e5e970d-0b80-4842-b83a-ef1dcedf2517 (4e5e970d-0b80-4842-b83a-ef1dcedf2517): created successfully Sep 17 07:56:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4732ed3-bebf-497f-a44a-a324650443c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Flow 'volume_create_manager' (6e58c55c-0937-4835-a668-b9401c088139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:56:40 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e894b2b0-835b-4939-9242-390c04c02c79 tempest-VolumesListAdminTestJSON-493452358 None] Created volume successfully. Sep 17 07:56:41 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:56:41 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Flow 'volume_create_manager' (8feb2d12-3e02-42c4-abf5-3e287bf6d611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0f94f2-a49f-46d2-aaa1-d1698e31d236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0f94f2-a49f-46d2-aaa1-d1698e31d236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-233253159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7924ed0d-8a3c-4e5b-baea-4adff14186ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5e7497d7c341848e1b82aed2fa9beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:42Z,use_quota=True,user_id='44f0c80764044807b2356312bea24c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cada46-03a4-47aa-87cf-c88ccf2a69e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cada46-03a4-47aa-87cf-c88ccf2a69e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26c62ff-3954-4fe1-9d78-15ba020a61d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26c62ff-3954-4fe1-9d78-15ba020a61d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7924ed0d-8a3c-4e5b-baea-4adff14186ad', 'volume_name': 'volume-7924ed0d-8a3c-4e5b-baea-4adff14186ad', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7333fdf4-43e3-4ad7-aebc-71d9aec36d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7333fdf4-43e3-4ad7-aebc-71d9aec36d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e2b500-e8e4-415a-b9bf-85b591855729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:42 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Volume 7924ed0d-8a3c-4e5b-baea-4adff14186ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7924ed0d-8a3c-4e5b-baea-4adff14186ad', 'volume_size': 1} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-233253159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7924ed0d-8a3c-4e5b-baea-4adff14186ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5e7497d7c341848e1b82aed2fa9beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:42Z,use_quota=True,user_id='44f0c80764044807b2356312bea24c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Creating volume 7924ed0d-8a3c-4e5b-baea-4adff14186ad {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:56:42 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7924ed0d-8a3c-4e5b-baea-4adff14186ad 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:42 devstack quobyte-client[83219]: System call of process 98256 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:56:42 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=110, name=volume-7924ed0d-8a3c-4e5b-baea-4adff14186ad, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7924ed0d-8a3c-4e5b-baea-4adff14186ad 1073741824" returned: 0 in 0.370s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7924ed0d-8a3c-4e5b-baea-4adff14186ad {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7924ed0d-8a3c-4e5b-baea-4adff14186ad" returned: 0 in 0.084s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] <== create_volume: return (544ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.556s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e2b500-e8e4-415a-b9bf-85b591855729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7924ed0d-8a3c-4e5b-baea-4adff14186ad', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc7406fb-6cca-4985-b934-54e836a91c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:42 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Volume volume-7924ed0d-8a3c-4e5b-baea-4adff14186ad (7924ed0d-8a3c-4e5b-baea-4adff14186ad): created successfully Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc7406fb-6cca-4985-b934-54e836a91c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Flow 'volume_create_manager' (8feb2d12-3e02-42c4-abf5-3e287bf6d611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:56:43 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-bc4965a2-1d73-4dfb-9609-331636da9d54 tempest-VolumesListAdminTestJSON-493452358 None] Created volume successfully. Sep 17 07:56:44 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:56:44 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:56:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Flow 'volume_create_manager' (8a686dda-9b3a-47e9-90d8-cbf718ecb66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:56:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64a9472-4169-48f2-973b-b920d98fe0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64a9472-4169-48f2-973b-b920d98fe0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917de314-709e-4837-bc76-df222fcd6395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093a4ca77c8f46618d709902888ac0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:45Z,use_quota=True,user_id='83bd51912f7b411088f3866cce995f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5a2d3f-1d65-48ca-9e6a-4e737788cf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5a2d3f-1d65-48ca-9e6a-4e737788cf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7a9cb3-cb68-4b0a-978f-4e4ad623a2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7a9cb3-cb68-4b0a-978f-4e4ad623a2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '917de314-709e-4837-bc76-df222fcd6395', 'volume_name': 'volume-917de314-709e-4837-bc76-df222fcd6395', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81f1093-6d89-45e2-81e4-8ac5b7f04694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81f1093-6d89-45e2-81e4-8ac5b7f04694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3c1dba-884f-4656-a084-05dc59cf8dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:45 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Volume 917de314-709e-4837-bc76-df222fcd6395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-917de314-709e-4837-bc76-df222fcd6395', 'volume_size': 1} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917de314-709e-4837-bc76-df222fcd6395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='093a4ca77c8f46618d709902888ac0f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:45Z,use_quota=True,user_id='83bd51912f7b411088f3866cce995f5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Creating volume 917de314-709e-4837-bc76-df222fcd6395 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:56:45 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-917de314-709e-4837-bc76-df222fcd6395 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:45 devstack quobyte-client[83219]: System call of process 98261 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:56:45 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=111, name=volume-917de314-709e-4837-bc76-df222fcd6395, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-917de314-709e-4837-bc76-df222fcd6395 1073741824" returned: 0 in 0.338s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-917de314-709e-4837-bc76-df222fcd6395 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-917de314-709e-4837-bc76-df222fcd6395" returned: 0 in 0.112s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] <== create_volume: return (524ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.534s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3c1dba-884f-4656-a084-05dc59cf8dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-917de314-709e-4837-bc76-df222fcd6395', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bba89f0-bef0-4f91-851b-8b519eb3b244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:45 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Volume volume-917de314-709e-4837-bc76-df222fcd6395 (917de314-709e-4837-bc76-df222fcd6395): created successfully Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bba89f0-bef0-4f91-851b-8b519eb3b244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Flow 'volume_create_manager' (8a686dda-9b3a-47e9-90d8-cbf718ecb66f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:56:45 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e43b33c5-89d2-43f9-ba94-ab42f15791f9 tempest-VolumesListAdminTestJSON-1338765744 None] Created volume successfully. Sep 17 07:56:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Acquiring lock "cinder-917de314-709e-4837-bc76-df222fcd6395-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:56:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Lock "cinder-917de314-709e-4837-bc76-df222fcd6395-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:56:47 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:56:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Acquiring lock "cinder-quobyte-917de314-709e-4837-bc76-df222fcd6395" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:56:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Lock "cinder-quobyte-917de314-709e-4837-bc76-df222fcd6395" acquired by "delete_volume" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:56:47 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ff31c5-ddd3-457b-9de8-d48ccf957a48]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:56:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-917de314-709e-4837-bc76-df222fcd6395 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "cinder-7924ed0d-8a3c-4e5b-baea-4adff14186ad-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:56:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Lock "cinder-7924ed0d-8a3c-4e5b-baea-4adff14186ad-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:56:48 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:56:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "cinder-quobyte-7924ed0d-8a3c-4e5b-baea-4adff14186ad" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:56:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Lock "cinder-quobyte-7924ed0d-8a3c-4e5b-baea-4adff14186ad" acquired by "delete_volume" :: waited 0.014s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:56:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-917de314-709e-4837-bc76-df222fcd6395" returned: 0 in 0.681s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-917de314-709e-4837-bc76-df222fcd6395 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:48 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c3446f-3e30-47d3-8204-242e973e3305]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:56:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7924ed0d-8a3c-4e5b-baea-4adff14186ad {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-917de314-709e-4837-bc76-df222fcd6395" returned: 0 in 0.212s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Lock "cinder-quobyte-917de314-709e-4837-bc76-df222fcd6395" released by "delete_volume" :: held 1.099s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:56:48 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Created reservations ['10be52aa-71be-4e10-9c1e-bf0d81871d46', '34578ad7-9d6f-450f-a201-17bc914ce3a1', '2a0e972b-71bc-4abd-9fee-0ee5355d948a', '77b132de-cd2e-4c84-b6f1-4842d4ffd5de'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:56:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7924ed0d-8a3c-4e5b-baea-4adff14186ad" returned: 0 in 0.694s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7924ed0d-8a3c-4e5b-baea-4adff14186ad {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.029s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-7924ed0d-8a3c-4e5b-baea-4adff14186ad" returned: 0 in 0.326s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Lock "cinder-quobyte-7924ed0d-8a3c-4e5b-baea-4adff14186ad" released by "delete_volume" :: held 1.302s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.380s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:56:49 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Deleted volume successfully. Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d631285e-133d-46f7-97be-e130aac73abe tempest-VolumesListAdminTestJSON-1338765744 None] Lock "cinder-917de314-709e-4837-bc76-df222fcd6395-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Created reservations ['90b64943-c5b0-44d4-afb5-e2623cb22b94', '4ca00859-202a-4aa3-bdb7-4329b1b0c18e', 'c5c29ea1-e8cd-4cd0-a43a-65a05adfa904', '76b3aad8-44f3-4489-a5e7-bc35ee6c1771'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.117s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:50 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:56:50 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Deleted volume successfully. Sep 17 07:56:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e5e0cbff-e666-4d51-8cb5-fa153d844ea4 tempest-VolumesListAdminTestJSON-493452358 None] Lock "cinder-7924ed0d-8a3c-4e5b-baea-4adff14186ad-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:56:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "cinder-4e5e970d-0b80-4842-b83a-ef1dcedf2517-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:56:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Lock "cinder-4e5e970d-0b80-4842-b83a-ef1dcedf2517-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:56:51 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:56:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "cinder-quobyte-4e5e970d-0b80-4842-b83a-ef1dcedf2517" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:56:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Lock "cinder-quobyte-4e5e970d-0b80-4842-b83a-ef1dcedf2517" acquired by "delete_volume" :: waited 0.017s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:56:51 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7946a57f-1e75-434d-88e5-597166470029]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:56:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4e5e970d-0b80-4842-b83a-ef1dcedf2517 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4e5e970d-0b80-4842-b83a-ef1dcedf2517" returned: 0 in 0.469s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4e5e970d-0b80-4842-b83a-ef1dcedf2517 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4e5e970d-0b80-4842-b83a-ef1dcedf2517" returned: 0 in 0.097s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Lock "cinder-quobyte-4e5e970d-0b80-4842-b83a-ef1dcedf2517" released by "delete_volume" :: held 0.738s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:56:52 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Created reservations ['96b92159-58fe-4f11-b5e7-dbed391fce30', 'baec1753-bb52-449c-a0cd-d8962148401a', '7ecc8076-410e-4bf0-903c-54d0433eb310', '42ba0ffd-67a5-4d94-8eac-d6a6fd39019b'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:56:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:56:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:56:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.092s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:52 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:56:52 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Deleted volume successfully. Sep 17 07:56:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f1040570-13a5-469b-b33a-aacf16fb9f4e tempest-VolumesListAdminTestJSON-493452358 None] Lock "cinder-4e5e970d-0b80-4842-b83a-ef1dcedf2517-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:56:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "cinder-9f2b6f00-817c-4471-adfd-48a202711c30-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:56:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Lock "cinder-9f2b6f00-817c-4471-adfd-48a202711c30-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:56:53 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:56:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "cinder-quobyte-9f2b6f00-817c-4471-adfd-48a202711c30" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:56:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Lock "cinder-quobyte-9f2b6f00-817c-4471-adfd-48a202711c30" acquired by "delete_volume" :: waited 0.011s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:56:53 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[658a9933-5e46-46ae-b799-1affa85a77f2]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:56:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9f2b6f00-817c-4471-adfd-48a202711c30 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9f2b6f00-817c-4471-adfd-48a202711c30" returned: 0 in 0.419s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9f2b6f00-817c-4471-adfd-48a202711c30 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-9f2b6f00-817c-4471-adfd-48a202711c30" returned: 0 in 0.091s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Lock "cinder-quobyte-9f2b6f00-817c-4471-adfd-48a202711c30" released by "delete_volume" :: held 0.661s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:56:54 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Created reservations ['b662ec57-1d17-45b2-907d-193fc6c78e21', 'a241cbf8-24b8-411f-8066-220a7e63cca1', '090d7009-a234-486c-8462-304efe7b4ea2', '4d13baf5-2753-4904-956b-f47d1617768a'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:56:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:56:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:56:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.109s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:54 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:56:54 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Deleted volume successfully. Sep 17 07:56:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-bbac6379-54ba-4037-936a-4347271a322d tempest-VolumesListAdminTestJSON-493452358 None] Lock "cinder-9f2b6f00-817c-4471-adfd-48a202711c30-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:56:56 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Flow 'volume_create_manager' (4be70fa7-f283-41d6-a80a-d995b0624819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2b620b-2dad-46c5-9afb-2e9afc965fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2b620b-2dad-46c5-9afb-2e9afc965fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1441999626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7488969a2d7647d78a7cb11c8b5eecd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:56Z,use_quota=True,user_id='57d68a4b2f644510a0738abbe154f841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c09d8c-c3dc-4c09-8448-5d3fac5ecd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c09d8c-c3dc-4c09-8448-5d3fac5ecd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e00145-3851-4cf4-94a9-f34bc314db7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e00145-3851-4cf4-94a9-f34bc314db7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc', 'volume_name': 'volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc3dc72-f3a8-4f5f-bd99-0afcd233023b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc3dc72-f3a8-4f5f-bd99-0afcd233023b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29481e46-9d5b-48bb-9bbc-438fdac21028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:56 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Volume a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc', 'volume_size': 1} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1441999626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7488969a2d7647d78a7cb11c8b5eecd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:56:56Z,use_quota=True,user_id='57d68a4b2f644510a0738abbe154f841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Creating volume a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:56:56 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:56:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:56 devstack quobyte-client[83219]: System call of process 98288 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:56:56 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=112, name=volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:56:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc 1073741824" returned: 0 in 0.379s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:56:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc" returned: 0 in 0.116s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:56:57 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] <== create_volume: return (557ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:56:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.569s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:56:57 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29481e46-9d5b-48bb-9bbc-438fdac21028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:57 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49003af-c114-4f6e-a108-b74dfc1a2831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:56:57 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Volume volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc (a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc): created successfully Sep 17 07:56:57 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49003af-c114-4f6e-a108-b74dfc1a2831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:56:57 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Flow 'volume_create_manager' (4be70fa7-f283-41d6-a80a-d995b0624819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:56:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-6bf5480d-5da7-445b-92e6-5210e9c0ce9b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Created volume successfully. Sep 17 07:57:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-990ef412-c6f7-45d3-91c7-2a32ff4c8351 req-30024d73-cc9b-4ec8-80ef-3aa00904b914 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-990ef412-c6f7-45d3-91c7-2a32ff4c8351 req-30024d73-cc9b-4ec8-80ef-3aa00904b914 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:02 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4ad111-8279-4f39-befd-fd57f62f81c7]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:57:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-990ef412-c6f7-45d3-91c7-2a32ff4c8351 req-30024d73-cc9b-4ec8-80ef-3aa00904b914 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-990ef412-c6f7-45d3-91c7-2a32ff4c8351 req-30024d73-cc9b-4ec8-80ef-3aa00904b914 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc" returned: 0 in 0.503s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-990ef412-c6f7-45d3-91c7-2a32ff4c8351 req-30024d73-cc9b-4ec8-80ef-3aa00904b914 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.566s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-990ef412-c6f7-45d3-91c7-2a32ff4c8351 req-30024d73-cc9b-4ec8-80ef-3aa00904b914 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14d2b644-12c5-4895-b8ac-78f04ab0156b', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 07:57:03 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-990ef412-c6f7-45d3-91c7-2a32ff4c8351 req-30024d73-cc9b-4ec8-80ef-3aa00904b914 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:03 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-990ef412-c6f7-45d3-91c7-2a32ff4c8351 req-30024d73-cc9b-4ec8-80ef-3aa00904b914 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] attachment_update completed successfully. Sep 17 07:57:03 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:03 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:57:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Flow 'volume_create_manager' (d98740d5-d2d7-4619-a771-ebccbb3489a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:57:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a32966-5365-4c19-970e-56fc907698f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a32966-5365-4c19-970e-56fc907698f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1378494663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7044d9-2828-4223-af8a-3d15fa0178f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec0c956a5e474b96a7f0ad1ed3e21e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:04Z,use_quota=True,user_id='637db5bc665e4c448cbb2da083619710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe6f061-0800-4ed0-8136-8fb9e38875d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe6f061-0800-4ed0-8136-8fb9e38875d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af25960f-3a6d-4f48-84d1-71256874be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af25960f-3a6d-4f48-84d1-71256874be46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eb7044d9-2828-4223-af8a-3d15fa0178f2', 'volume_name': 'volume-eb7044d9-2828-4223-af8a-3d15fa0178f2', 'volume_size': 1, 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91606166160a47f193bac06562c1b40d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c23af952-419c-402d-9c13-65fae52513d0', 'created_at': datetime.datetime(2025, 9, 17, 5, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23af952-419c-402d-9c13-65fae52513d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216195e9-0d13-493b-8a44-6ce9ec5346a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216195e9-0d13-493b-8a44-6ce9ec5346a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e44323a-468f-4317-b50f-b1dcb7b7ea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:04 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Volume eb7044d9-2828-4223-af8a-3d15fa0178f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eb7044d9-2828-4223-af8a-3d15fa0178f2', 'volume_size': 1, 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91606166160a47f193bac06562c1b40d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c23af952-419c-402d-9c13-65fae52513d0', 'created_at': datetime.datetime(2025, 9, 17, 5, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23af952-419c-402d-9c13-65fae52513d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 07:57:04 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Cloning eb7044d9-2828-4223-af8a-3d15fa0178f2 from image c23af952-419c-402d-9c13-65fae52513d0 at location (None, None). {{(pid=83207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}} Sep 17 07:57:04 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_7y44tdtjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 17 07:57:04 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Image download 20.69 MB at 20.69 MB/s Sep 17 07:57:04 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[918ffcd6-4f6f-447b-b165-b05870b32c74]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:57:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_7y44tdtjdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:05 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_7y44tdtjdevstack@QuobyteHD Sep 17 07:57:05 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:57:07 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Sep 17 07:57:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_7y44tdtjdevstack@QuobyteHD" returned: 0 in 2.692s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:07 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Temporary image c23af952-419c-402d-9c13-65fae52513d0 is fetched for user 637db5bc665e4c448cbb2da083619710. {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 17 07:57:08 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c13c971-f546-4e28-ae33-f37c73514917]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:57:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_7y44tdtjdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:08 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_7y44tdtjdevstack@QuobyteHD Sep 17 07:57:08 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 07:57:10 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Sep 17 07:57:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_7y44tdtjdevstack@QuobyteHD" returned: 0 in 2.388s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1378494663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7044d9-2828-4223-af8a-3d15fa0178f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec0c956a5e474b96a7f0ad1ed3e21e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:04Z,use_quota=True,user_id='637db5bc665e4c448cbb2da083619710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:57:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Creating volume eb7044d9-2828-4223-af8a-3d15fa0178f2 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:57:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:57:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:57:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:57:10 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:57:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:10 devstack quobyte-client[83219]: System call of process 98711 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:57:10 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=113, name=volume-eb7044d9-2828-4223-af8a-3d15fa0178f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:57:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2 1073741824" returned: 0 in 0.390s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2" returned: 0 in 0.088s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:11 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] <== create_volume: return (578ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:57:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.612s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:11 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Attempting download of c23af952-419c-402d-9c13-65fae52513d0 ((None, None)) to volume eb7044d9-2828-4223-af8a-3d15fa0178f2. {{(pid=83207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 17 07:57:11 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdfd099-161e-4109-8eea-72af1bc9b1da]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:57:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_1l71akmo {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_1l71akmo" returned: 0 in 0.374s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_1l71akmo {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_1l71akmo" returned: 1 in 0.457s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_1l71akmo' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:57:12 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[218b3d4e-4806-414e-9659-4b746028b577]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:57:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_7y44tdtjdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_7y44tdtjdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:13 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] c23af952-419c-402d-9c13-65fae52513d0 was qcow2, converting to raw {{(pid=83207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 17 07:57:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_7y44tdtjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:13 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=113, name=volume-eb7044d9-2828-4223-af8a-3d15fa0178f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:57:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_7y44tdtjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2" returned: 0 in 1.126s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:14 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_7y44tdtjdevstack@QuobyteHD, size 112.00 MB, duration 1.16 sec, destination /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2 {{(pid=83207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 07:57:14 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Converted 112.00 MB image at 96.53 MB/s Sep 17 07:57:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:14 devstack quobyte-client[83219]: System call of process 98733 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:57:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2 1G" returned: 0 in 0.195s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:14 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18ec670-3a0d-4790-9a8c-e8297fdf025c]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:57:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2" returned: 0 in 0.412s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2" returned: 1 in 0.408s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:57:15 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Downloaded image c23af952-419c-402d-9c13-65fae52513d0 ((None, None)) to volume eb7044d9-2828-4223-af8a-3d15fa0178f2 successfully. {{(pid=83207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 17 07:57:15 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Temporary image c23af952-419c-402d-9c13-65fae52513d0 for user 637db5bc665e4c448cbb2da083619710 is deleted. {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 17 07:57:15 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Marking volume eb7044d9-2828-4223-af8a-3d15fa0178f2 as bootable. {{(pid=83207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 17 07:57:15 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Copying metadata from image c23af952-419c-402d-9c13-65fae52513d0 to eb7044d9-2828-4223-af8a-3d15fa0178f2. {{(pid=83207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 07:57:15 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Creating volume glance metadata for volume eb7044d9-2828-4223-af8a-3d15fa0178f2 backed by image c23af952-419c-402d-9c13-65fae52513d0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 07:57:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e44323a-468f-4317-b50f-b1dcb7b7ea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb7044d9-2828-4223-af8a-3d15fa0178f2', 'volume_size': 1, 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91606166160a47f193bac06562c1b40d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c23af952-419c-402d-9c13-65fae52513d0', 'created_at': datetime.datetime(2025, 9, 17, 5, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23af952-419c-402d-9c13-65fae52513d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6a662a-841a-444f-b421-f6d96ebbd965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:15 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Volume volume-eb7044d9-2828-4223-af8a-3d15fa0178f2 (eb7044d9-2828-4223-af8a-3d15fa0178f2): created successfully Sep 17 07:57:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6a662a-841a-444f-b421-f6d96ebbd965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Flow 'volume_create_manager' (d98740d5-d2d7-4619-a771-ebccbb3489a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:57:15 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-507359eb-3d36-4d2b-96b7-5194a9a3e673 tempest-VolumesImageMetadata-1353130990 None] Created volume successfully. Sep 17 07:57:16 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Acquiring lock "cinder-eb7044d9-2828-4223-af8a-3d15fa0178f2-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:57:16 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Lock "cinder-eb7044d9-2828-4223-af8a-3d15fa0178f2-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:57:16 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:16 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Acquiring lock "cinder-quobyte-eb7044d9-2828-4223-af8a-3d15fa0178f2" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:57:16 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Lock "cinder-quobyte-eb7044d9-2828-4223-af8a-3d15fa0178f2" acquired by "delete_volume" :: waited 0.023s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:57:16 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ec773e-1a6b-4e23-b4c4-d9af2f483ae7]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:57:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2" returned: 0 in 0.431s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:17 devstack quobyte-client[83219]: System call of process 98747 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:57:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2" returned: 1 in 0.386s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 07:57:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-eb7044d9-2828-4223-af8a-3d15fa0178f2" returned: 0 in 0.095s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Lock "cinder-quobyte-eb7044d9-2828-4223-af8a-3d15fa0178f2" released by "delete_volume" :: held 1.179s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:57:18 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Created reservations ['4da28b02-e6e4-4179-8304-a91609681c1a', 'ae8e2ab0-871c-430e-bbe5-a39c4f21b244', 'e830bee3-b0a0-4d6c-84d8-123ae41934e7', 'a46aa47f-cb8d-49ea-841a-a03bff80ecb6'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:57:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:57:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:57:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.083s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:18 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:57:18 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Deleted volume successfully. Sep 17 07:57:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4e563292-7666-4af0-9879-012be25130c4 tempest-VolumesImageMetadata-1353130990 None] Lock "cinder-eb7044d9-2828-4223-af8a-3d15fa0178f2-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:57:23 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Flow 'volume_create_manager' (7ee90d6f-c42c-4e00-a1b6-c8b01314e2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bcce92-0ec3-4301-8919-b2f6431ea408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bcce92-0ec3-4301-8919-b2f6431ea408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-873418115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62b9031-7462-4cb0-958b-893399bb7d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c65440f484484b8780dfd799e75125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:23Z,use_quota=True,user_id='613db4fab9734e49ac474bbd874133ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e6fe66-16d0-4f57-9b68-df33e7d03cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e6fe66-16d0-4f57-9b68-df33e7d03cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a280d06-13f8-4332-8831-a138c574638d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a280d06-13f8-4332-8831-a138c574638d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b62b9031-7462-4cb0-958b-893399bb7d75', 'volume_name': 'volume-b62b9031-7462-4cb0-958b-893399bb7d75', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d9e7ad-bf17-4d89-8b56-c4612d85a61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d9e7ad-bf17-4d89-8b56-c4612d85a61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e41ddbb-f95f-43ae-bcf5-3ef8c6243012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:23 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Volume b62b9031-7462-4cb0-958b-893399bb7d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b62b9031-7462-4cb0-958b-893399bb7d75', 'volume_size': 1} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-873418115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62b9031-7462-4cb0-958b-893399bb7d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c65440f484484b8780dfd799e75125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:23Z,use_quota=True,user_id='613db4fab9734e49ac474bbd874133ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Creating volume b62b9031-7462-4cb0-958b-893399bb7d75 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:57:23 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:57:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b62b9031-7462-4cb0-958b-893399bb7d75 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:23 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=114, name=volume-b62b9031-7462-4cb0-958b-893399bb7d75, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:57:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b62b9031-7462-4cb0-958b-893399bb7d75 1073741824" returned: 0 in 0.316s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b62b9031-7462-4cb0-958b-893399bb7d75 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b62b9031-7462-4cb0-958b-893399bb7d75" returned: 0 in 0.090s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:24 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] <== create_volume: return (472ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:57:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.484s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e41ddbb-f95f-43ae-bcf5-3ef8c6243012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b62b9031-7462-4cb0-958b-893399bb7d75', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4992683a-a6fe-44bf-8e42-3127a26b7590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:24 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Volume volume-b62b9031-7462-4cb0-958b-893399bb7d75 (b62b9031-7462-4cb0-958b-893399bb7d75): created successfully Sep 17 07:57:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4992683a-a6fe-44bf-8e42-3127a26b7590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Flow 'volume_create_manager' (7ee90d6f-c42c-4e00-a1b6-c8b01314e2a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:57:24 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-8c339cb8-ecef-440e-8af4-441568c5e1ca tempest-VolumesTransfersV355Test-400909700 None] Created volume successfully. Sep 17 07:57:26 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-78b81177-0b4a-4558-bb78-f558bf1b2416 tempest-VolumesTransfersV355Test-1150139534 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:26 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-78b81177-0b4a-4558-bb78-f558bf1b2416 tempest-VolumesTransfersV355Test-1150139534 None] Transfer volume completed successfully. Sep 17 07:57:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Acquiring lock "cinder-b62b9031-7462-4cb0-958b-893399bb7d75-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:57:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Lock "cinder-b62b9031-7462-4cb0-958b-893399bb7d75-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:57:27 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=45,cinder:UPDATE=58,cinder:DELETE=8,cinder:INSERT=13 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:57:27 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=47,cinder:UPDATE=57,cinder:DELETE=4,cinder:INSERT=20 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:57:27 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Acquiring lock "cinder-quobyte-b62b9031-7462-4cb0-958b-893399bb7d75" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:57:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Lock "cinder-quobyte-b62b9031-7462-4cb0-958b-893399bb7d75" acquired by "delete_volume" :: waited 0.024s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:57:27 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[622c88a0-0770-4017-8562-138733a835cb]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:57:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b62b9031-7462-4cb0-958b-893399bb7d75 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:57:28 devstack quobyte-client[83219]: System call of process 98814 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b62b9031-7462-4cb0-958b-893399bb7d75" returned: 0 in 0.523s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b62b9031-7462-4cb0-958b-893399bb7d75 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.209s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b62b9031-7462-4cb0-958b-893399bb7d75" returned: 0 in 0.173s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Lock "cinder-quobyte-b62b9031-7462-4cb0-958b-893399bb7d75" released by "delete_volume" :: held 0.857s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Created reservations ['04eae1c3-fed3-448a-ae5e-8b51e03c3feb', '1fe347e3-b5a8-48db-baa8-c1cc1a47f388', '7bacfddb-6ad0-4be3-ba8a-d16c32d72368', '52203959-71a3-45de-9a65-df566a29558f'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.085s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:57:29 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Deleted volume successfully. Sep 17 07:57:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b120fd6c-9cf5-4f64-9756-d50280422aca tempest-VolumesTransfersV355Test-1986891692 None] Lock "cinder-b62b9031-7462-4cb0-958b-893399bb7d75-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:57:30 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Flow 'volume_create_manager' (3fe2057a-fbe4-45ad-afc8-3e3fec2cf485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d417d9d0-c4a2-42b4-a0ae-962e2d555d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d417d9d0-c4a2-42b4-a0ae-962e2d555d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1595349684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920b78fb-5cb3-42ed-a751-03a2a63d5231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c65440f484484b8780dfd799e75125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:30Z,use_quota=True,user_id='613db4fab9734e49ac474bbd874133ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f67a690-8dad-47da-a5f5-cbf9096970ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f67a690-8dad-47da-a5f5-cbf9096970ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0255b0-6d2a-4c62-98c4-815cea68f623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c0255b0-6d2a-4c62-98c4-815cea68f623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '920b78fb-5cb3-42ed-a751-03a2a63d5231', 'volume_name': 'volume-920b78fb-5cb3-42ed-a751-03a2a63d5231', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01618d02-b0e3-4ba4-af60-dea4977239e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01618d02-b0e3-4ba4-af60-dea4977239e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2111e2-6fab-4a25-acd7-1a462fba3593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:30 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Volume 920b78fb-5cb3-42ed-a751-03a2a63d5231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-920b78fb-5cb3-42ed-a751-03a2a63d5231', 'volume_size': 1} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1595349684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920b78fb-5cb3-42ed-a751-03a2a63d5231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1c65440f484484b8780dfd799e75125',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:30Z,use_quota=True,user_id='613db4fab9734e49ac474bbd874133ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Creating volume 920b78fb-5cb3-42ed-a751-03a2a63d5231 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:57:30 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-920b78fb-5cb3-42ed-a751-03a2a63d5231 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:30 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=115, name=volume-920b78fb-5cb3-42ed-a751-03a2a63d5231, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:57:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-920b78fb-5cb3-42ed-a751-03a2a63d5231 1073741824" returned: 0 in 0.312s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-920b78fb-5cb3-42ed-a751-03a2a63d5231 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-920b78fb-5cb3-42ed-a751-03a2a63d5231" returned: 0 in 0.100s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] <== create_volume: return (481ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:57:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.494s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:31 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f2111e2-6fab-4a25-acd7-1a462fba3593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920b78fb-5cb3-42ed-a751-03a2a63d5231', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:31 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f15c31-b125-4aa3-be18-5a2ccfc8338f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:31 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Volume volume-920b78fb-5cb3-42ed-a751-03a2a63d5231 (920b78fb-5cb3-42ed-a751-03a2a63d5231): created successfully Sep 17 07:57:31 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f15c31-b125-4aa3-be18-5a2ccfc8338f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:31 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Flow 'volume_create_manager' (3fe2057a-fbe4-45ad-afc8-3e3fec2cf485) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:57:31 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-8cc31c1d-75f6-4489-a41d-da81f68e6020 tempest-VolumesTransfersV355Test-400909700 None] Created volume successfully. Sep 17 07:57:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Acquiring lock "cinder-920b78fb-5cb3-42ed-a751-03a2a63d5231-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:57:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Lock "cinder-920b78fb-5cb3-42ed-a751-03a2a63d5231-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:57:32 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Acquiring lock "cinder-quobyte-920b78fb-5cb3-42ed-a751-03a2a63d5231" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:57:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Lock "cinder-quobyte-920b78fb-5cb3-42ed-a751-03a2a63d5231" acquired by "delete_volume" :: waited 0.010s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:57:32 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[71581b2f-6eb4-4500-8e5f-6eb44a774275]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:57:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-920b78fb-5cb3-42ed-a751-03a2a63d5231 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-920b78fb-5cb3-42ed-a751-03a2a63d5231" returned: 0 in 0.390s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-920b78fb-5cb3-42ed-a751-03a2a63d5231 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-920b78fb-5cb3-42ed-a751-03a2a63d5231" returned: 0 in 0.098s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:33 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Lock "cinder-quobyte-920b78fb-5cb3-42ed-a751-03a2a63d5231" released by "delete_volume" :: held 0.624s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:57:33 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Created reservations ['1532b2de-27ef-45b5-81e8-bdc936ca1aeb', 'b2864504-ed48-4d99-b997-01a6332646ad', '7f6a7270-678b-4651-bb85-03db92683945', 'a400c270-facf-4df6-9b5a-8fe13e471872'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:57:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:33 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:57:34 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:57:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.084s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:34 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:57:34 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Deleted volume successfully. Sep 17 07:57:34 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d462366d-b8a6-4316-9527-ba932684dec6 tempest-VolumesTransfersV355Test-1986891692 None] Lock "cinder-920b78fb-5cb3-42ed-a751-03a2a63d5231-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:57:35 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-03fc7b89-eb9e-4220-a941-e097f0d7c338 req-8879e883-d19a-42d5-99ae-59c83d3d410b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:35 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-03fc7b89-eb9e-4220-a941-e097f0d7c338 req-8879e883-d19a-42d5-99ae-59c83d3d410b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:35 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-03fc7b89-eb9e-4220-a941-e097f0d7c338 req-8879e883-d19a-42d5-99ae-59c83d3d410b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Terminate volume connection completed successfully. Sep 17 07:57:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-03fc7b89-eb9e-4220-a941-e097f0d7c338 req-8879e883-d19a-42d5-99ae-59c83d3d410b tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Deleting attachment 14d2b644-12c5-4895-b8ac-78f04ab0156b. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 07:57:37 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Acquiring lock "cinder-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:57:37 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Lock "cinder-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:57:37 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:37 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Acquiring lock "cinder-quobyte-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:57:37 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Lock "cinder-quobyte-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc" acquired by "delete_volume" :: waited 0.012s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:57:37 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5219cc-2ef8-4ec5-8c44-659cbd51c46a]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:57:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc" returned: 0 in 0.460s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc" returned: 0 in 0.119s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:38 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Lock "cinder-quobyte-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc" released by "delete_volume" :: held 0.742s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:57:38 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Created reservations ['801e3a81-6d95-409b-9f34-1297f92187a4', 'e92b1db8-0bf9-4dcc-9ab2-708044c7fda4', '53e718dd-abc7-4eaa-af4e-ee6a5f3e07c8', '3dfb8342-b341-42c8-8388-87cb247320e1'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:57:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:57:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:57:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.092s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:38 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:57:38 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Deleted volume successfully. Sep 17 07:57:39 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91bc14ef-211c-4d76-88a6-9d24c23d1db7 tempest-TestServerVolumeAttachScenarioOldVersion-703086164 None] Lock "cinder-a28bda2c-4d1a-4d70-81c4-bebfdc2ac9bc-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:57:45 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:45 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:57:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Flow 'volume_create_manager' (d4036930-86d9-4e78-b80c-ac9f5847ef2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:57:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e78b8e-c844-44c2-8681-4dc9ccce0335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41e78b8e-c844-44c2-8681-4dc9ccce0335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1685526001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f93c808e304ba98dea5e7597cc0490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:46Z,use_quota=True,user_id='7f6b8e3d087b44798cfd0c953347d4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c7fb1c7-8c8d-4872-9b18-fe5f384bbb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c7fb1c7-8c8d-4872-9b18-fe5f384bbb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a457f8-c09d-43f1-8b91-eed9d9d65f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a457f8-c09d-43f1-8b91-eed9d9d65f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2', 'volume_name': 'volume-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff878693-fede-4df7-9a28-05a5af84332c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff878693-fede-4df7-9a28-05a5af84332c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6aff737-0469-499e-b878-be0f7b88e304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:46 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Volume 5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2', 'volume_size': 1} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1685526001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f93c808e304ba98dea5e7597cc0490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:46Z,use_quota=True,user_id='7f6b8e3d087b44798cfd0c953347d4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Creating volume 5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:57:46 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:46 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=116, name=volume-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2 1073741824" returned: 0 in 0.408s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2" returned: 0 in 0.160s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] <== create_volume: return (660ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6aff737-0469-499e-b878-be0f7b88e304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3132f6c6-f922-44e7-b1ad-c94a1caa4fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:47 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Volume volume-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2 (5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2): created successfully Sep 17 07:57:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3132f6c6-f922-44e7-b1ad-c94a1caa4fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Flow 'volume_create_manager' (d4036930-86d9-4e78-b80c-ac9f5847ef2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:57:47 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c7741561-fa37-404a-9155-4cdb3f0c4541 tempest-VolumesTransfersV357Test-1137556016 None] Created volume successfully. Sep 17 07:57:48 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-2a4ac66a-99dd-4257-a6b3-096c419d6ff9 tempest-VolumesTransfersV357Test-1908969834 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:48 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-2a4ac66a-99dd-4257-a6b3-096c419d6ff9 tempest-VolumesTransfersV357Test-1908969834 None] Transfer volume completed successfully. Sep 17 07:57:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Acquiring lock "cinder-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:57:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Lock "cinder-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:57:49 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Acquiring lock "cinder-quobyte-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:57:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Lock "cinder-quobyte-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2" acquired by "delete_volume" :: waited 0.015s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:57:49 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[644b03ff-768d-4298-877a-a465da678430]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:57:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2" returned: 0 in 0.691s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2" returned: 0 in 0.144s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Lock "cinder-quobyte-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2" released by "delete_volume" :: held 1.006s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:57:51 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Created reservations ['3684f3c2-683b-4727-86a6-4a5371f75840', '11deda0f-a871-4ac6-af96-ac6e62fc2ec1', 'd1015584-5e5f-4af5-a72a-aceedae69fe8', '95e87f4d-e8e7-43b0-a540-9fbb473f5bfc'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:57:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:51 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:57:51 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:57:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.099s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:51 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:57:51 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Deleted volume successfully. Sep 17 07:57:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b9c29c85-3fb3-4455-b118-68e13ea29c50 tempest-VolumesTransfersV357Test-18022055 None] Lock "cinder-5512d7b9-a973-4f2b-9dd6-6b73dfeec3f2-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:57:52 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Flow 'volume_create_manager' (b18fdec5-f463-4664-a527-9cf4d97d887a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5e4cc7-dab7-4ba6-8db9-d61e5d851322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5e4cc7-dab7-4ba6-8db9-d61e5d851322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-354286925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa741555-3705-4b36-9350-7958e249e0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f93c808e304ba98dea5e7597cc0490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:52Z,use_quota=True,user_id='7f6b8e3d087b44798cfd0c953347d4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f410c67-e82a-4117-a2b8-e6d8eec6d82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f410c67-e82a-4117-a2b8-e6d8eec6d82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df1f9fa-f7e1-429c-b94a-4d50b457bd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df1f9fa-f7e1-429c-b94a-4d50b457bd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa741555-3705-4b36-9350-7958e249e0cd', 'volume_name': 'volume-fa741555-3705-4b36-9350-7958e249e0cd', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ec361d-acaa-4801-8da3-46064fa8157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ec361d-acaa-4801-8da3-46064fa8157a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9675f45f-ba5f-4e6f-853d-51d8a1e21897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:52 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Volume fa741555-3705-4b36-9350-7958e249e0cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa741555-3705-4b36-9350-7958e249e0cd', 'volume_size': 1} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-354286925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa741555-3705-4b36-9350-7958e249e0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f93c808e304ba98dea5e7597cc0490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:57:52Z,use_quota=True,user_id='7f6b8e3d087b44798cfd0c953347d4b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Creating volume fa741555-3705-4b36-9350-7958e249e0cd {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:57:52 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:57:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fa741555-3705-4b36-9350-7958e249e0cd 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:53 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=117, name=volume-fa741555-3705-4b36-9350-7958e249e0cd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:57:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fa741555-3705-4b36-9350-7958e249e0cd 1073741824" returned: 0 in 0.440s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fa741555-3705-4b36-9350-7958e249e0cd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fa741555-3705-4b36-9350-7958e249e0cd" returned: 0 in 0.177s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:53 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] <== create_volume: return (732ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:57:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:53 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9675f45f-ba5f-4e6f-853d-51d8a1e21897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa741555-3705-4b36-9350-7958e249e0cd', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:53 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0dcc652-3ab8-436b-87a1-e5f334e6ed19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:57:53 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Volume volume-fa741555-3705-4b36-9350-7958e249e0cd (fa741555-3705-4b36-9350-7958e249e0cd): created successfully Sep 17 07:57:53 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0dcc652-3ab8-436b-87a1-e5f334e6ed19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:57:53 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Flow 'volume_create_manager' (b18fdec5-f463-4664-a527-9cf4d97d887a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:57:53 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-be639ac1-5aa2-45ac-b97b-ac46d88a40e8 tempest-VolumesTransfersV357Test-1137556016 None] Created volume successfully. Sep 17 07:57:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Acquiring lock "cinder-fa741555-3705-4b36-9350-7958e249e0cd-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:57:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Lock "cinder-fa741555-3705-4b36-9350-7958e249e0cd-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:57:55 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:57:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Acquiring lock "cinder-quobyte-fa741555-3705-4b36-9350-7958e249e0cd" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:57:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Lock "cinder-quobyte-fa741555-3705-4b36-9350-7958e249e0cd" acquired by "delete_volume" :: waited 0.019s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:57:55 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dbdd20-58d8-4697-b63c-962e7d7f245b]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:57:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fa741555-3705-4b36-9350-7958e249e0cd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fa741555-3705-4b36-9350-7958e249e0cd" returned: 0 in 0.538s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fa741555-3705-4b36-9350-7958e249e0cd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fa741555-3705-4b36-9350-7958e249e0cd" returned: 0 in 0.112s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Lock "cinder-quobyte-fa741555-3705-4b36-9350-7958e249e0cd" released by "delete_volume" :: held 0.835s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:57:56 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Created reservations ['9ad9f62a-695a-4207-9796-3da5922dedb7', '27a9abcc-7721-4ccc-9093-5ea55ecccd64', '7375e79c-2b92-48ce-9cdb-54b00ec86cda', 'a564a728-7810-4a30-93bd-3509a234d061'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 07:57:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:57:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:57:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:57:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:57:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:57:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:57:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.109s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:57:57 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:57:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Deleted volume successfully. Sep 17 07:57:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-13c26821-39ee-4bea-8f84-535f482d2210 tempest-VolumesTransfersV357Test-18022055 None] Lock "cinder-fa741555-3705-4b36-9350-7958e249e0cd-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:58:06 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=30,cinder:INSERT=7,cinder:UPDATE=52,cinder:DELETE=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:58:07 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=29,cinder:INSERT=13,cinder:UPDATE=40,cinder:DELETE=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:58:20 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Flow 'volume_create_manager' (eea921cf-4f9d-41af-ade4-c9be988b7fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8871b90-9ff0-4439-8b34-6cc9bd19157d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8871b90-9ff0-4439-8b34-6cc9bd19157d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-680709595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8974b1f4-5592-4e4c-8096-b9dc7b41c450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0690ea5cf8643f0a91cbd193028a338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:58:21Z,use_quota=True,user_id='a0796aa422f64dbdaf70fa6c167a8cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b72e25c-3996-4222-9fbf-9843970fa652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b72e25c-3996-4222-9fbf-9843970fa652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1627ddb-1979-443b-af2e-02b2d921f579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1627ddb-1979-443b-af2e-02b2d921f579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8974b1f4-5592-4e4c-8096-b9dc7b41c450', 'volume_name': 'volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56015771-28dc-4850-babb-67b87c6819d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56015771-28dc-4850-babb-67b87c6819d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a749bf49-96b8-45d7-9564-0316e2a9c5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:20 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Volume 8974b1f4-5592-4e4c-8096-b9dc7b41c450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450', 'volume_size': 1} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-680709595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8974b1f4-5592-4e4c-8096-b9dc7b41c450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0690ea5cf8643f0a91cbd193028a338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:58:21Z,use_quota=True,user_id='a0796aa422f64dbdaf70fa6c167a8cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Creating volume 8974b1f4-5592-4e4c-8096-b9dc7b41c450 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:58:20 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:58:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:58:21 devstack quobyte-client[83219]: System call of process 98949 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:58:21 devstack quobyte-client[83219]: System call of process 98949 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:58:21 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=118, name=volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:58:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 1073741824" returned: 0 in 0.438s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:58:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:58:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450" returned: 0 in 0.160s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:58:21 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] <== create_volume: return (674ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:58:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:58:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a749bf49-96b8-45d7-9564-0316e2a9c5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b49e2dd-b65c-44b4-865f-76604393dc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:21 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Volume volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 (8974b1f4-5592-4e4c-8096-b9dc7b41c450): created successfully Sep 17 07:58:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b49e2dd-b65c-44b4-865f-76604393dc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Flow 'volume_create_manager' (eea921cf-4f9d-41af-ade4-c9be988b7fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:58:21 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ff3ae53d-7865-4d71-bd62-7bcbba39ad7c tempest-VolumesActionsTest-175841311 None] Created volume successfully. Sep 17 07:58:28 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:58:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:58:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:58:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:58:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:58:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:58:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:58:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.152s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:58:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:58:31 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:58:31 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:58:39 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Flow 'volume_create_manager' (11280fb4-bfd6-4dd5-b502-3b8cdf671e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e88390-4610-4b6a-b8a6-8447b953b59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e88390-4610-4b6a-b8a6-8447b953b59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1937711269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9f0739-78a9-465e-8711-84c9e8a53edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064ffb15fce84d828762b7e113725f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:58:39Z,use_quota=True,user_id='b837ae0abd484aada3cfe5091a4f812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57eb66ba-5eee-4d44-b8df-c3395ad9a2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57eb66ba-5eee-4d44-b8df-c3395ad9a2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88466ac-8b0c-468c-b6d1-bfcec048c47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88466ac-8b0c-468c-b6d1-bfcec048c47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e9f0739-78a9-465e-8711-84c9e8a53edd', 'volume_name': 'volume-2e9f0739-78a9-465e-8711-84c9e8a53edd', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469cbb37-4885-40c2-a098-b451532873f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469cbb37-4885-40c2-a098-b451532873f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676671c8-4d17-4ea4-a6db-2a7db067bb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:39 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume 2e9f0739-78a9-465e-8711-84c9e8a53edd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e9f0739-78a9-465e-8711-84c9e8a53edd', 'volume_size': 1} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1937711269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9f0739-78a9-465e-8711-84c9e8a53edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064ffb15fce84d828762b7e113725f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:58:39Z,use_quota=True,user_id='b837ae0abd484aada3cfe5091a4f812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Creating volume 2e9f0739-78a9-465e-8711-84c9e8a53edd {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:58:39 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:58:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2e9f0739-78a9-465e-8711-84c9e8a53edd 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:58:39 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=119, name=volume-2e9f0739-78a9-465e-8711-84c9e8a53edd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:58:40 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Flow 'volume_create_manager' (ec8807e0-c75f-40c7-a810-c5ce1e52a779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606a06c3-5574-446a-aeaa-1ab21710162a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (606a06c3-5574-446a-aeaa-1ab21710162a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-968612587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a39d946-9739-47c0-982c-c0880ce6e050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064ffb15fce84d828762b7e113725f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:58:39Z,use_quota=True,user_id='b837ae0abd484aada3cfe5091a4f812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11e17e3-e1d4-4e5d-8da4-47988f580de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f11e17e3-e1d4-4e5d-8da4-47988f580de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aea56f8-8192-4525-8f75-39599b83f240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aea56f8-8192-4525-8f75-39599b83f240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a39d946-9739-47c0-982c-c0880ce6e050', 'volume_name': 'volume-3a39d946-9739-47c0-982c-c0880ce6e050', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73f49a8-9a1e-465e-bcdf-036dabcb0725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73f49a8-9a1e-465e-bcdf-036dabcb0725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0bf75f3-0bf3-49ec-9bb3-3261ccf411b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:40 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume 3a39d946-9739-47c0-982c-c0880ce6e050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a39d946-9739-47c0-982c-c0880ce6e050', 'volume_size': 1} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2e9f0739-78a9-465e-8711-84c9e8a53edd 1073741824" returned: 0 in 0.773s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2e9f0739-78a9-465e-8711-84c9e8a53edd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2e9f0739-78a9-465e-8711-84c9e8a53edd" returned: 0 in 0.185s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] <== create_volume: return (1038ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:58:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.612s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T05:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-968612587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a39d946-9739-47c0-982c-c0880ce6e050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='064ffb15fce84d828762b7e113725f4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T05:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T05:58:39Z,use_quota=True,user_id='b837ae0abd484aada3cfe5091a4f812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Creating volume 3a39d946-9739-47c0-982c-c0880ce6e050 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 07:58:41 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3a39d946-9739-47c0-982c-c0880ce6e050 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:58:41 devstack quobyte-client[83219]: System call of process 99027 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 07:58:41 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=120, name=volume-3a39d946-9739-47c0-982c-c0880ce6e050, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676671c8-4d17-4ea4-a6db-2a7db067bb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9f0739-78a9-465e-8711-84c9e8a53edd', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806ed52e-f432-4fb3-af66-c31973a505a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3a39d946-9739-47c0-982c-c0880ce6e050 1073741824" returned: 0 in 0.615s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3a39d946-9739-47c0-982c-c0880ce6e050 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:58:41 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume volume-2e9f0739-78a9-465e-8711-84c9e8a53edd (2e9f0739-78a9-465e-8711-84c9e8a53edd): created successfully Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806ed52e-f432-4fb3-af66-c31973a505a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Flow 'volume_create_manager' (11280fb4-bfd6-4dd5-b502-3b8cdf671e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:58:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3a39d946-9739-47c0-982c-c0880ce6e050" returned: 0 in 0.415s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:58:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] <== create_volume: return (1091ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 07:58:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:58:42 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-6d173e80-e7dc-4721-a066-560938a2f6e4 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Created volume successfully. Sep 17 07:58:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0bf75f3-0bf3-49ec-9bb3-3261ccf411b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a39d946-9739-47c0-982c-c0880ce6e050', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03675983-dd02-4b2e-b910-dc87b145ecf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 07:58:42 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume volume-3a39d946-9739-47c0-982c-c0880ce6e050 (3a39d946-9739-47c0-982c-c0880ce6e050): created successfully Sep 17 07:58:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03675983-dd02-4b2e-b910-dc87b145ecf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 07:58:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Flow 'volume_create_manager' (ec8807e0-c75f-40c7-a810-c5ce1e52a779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 07:58:42 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5d1efda4-4f03-40bc-96eb-f687401cb1e3 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Created volume successfully. Sep 17 07:58:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-19dd97af-eea3-4ab8-ba9b-dc4afe971f30 tempest-VolumesActionsTest-175841311 None] Acquiring lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450" by "attach_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:58:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-19dd97af-eea3-4ab8-ba9b-dc4afe971f30 tempest-VolumesActionsTest-175841311 None] Lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450" acquired by "attach_volume" :: waited 0.036s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:58:51 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-19dd97af-eea3-4ab8-ba9b-dc4afe971f30 tempest-VolumesActionsTest-175841311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:58:51 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-19dd97af-eea3-4ab8-ba9b-dc4afe971f30 tempest-VolumesActionsTest-175841311 None] Attaching volume 8974b1f4-5592-4e4c-8096-b9dc7b41c450 to instance fa8f37fc-5cfa-49de-af90-9af5d45a88c9 at mountpoint /dev/vdb on host None. Sep 17 07:58:51 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-19dd97af-eea3-4ab8-ba9b-dc4afe971f30 tempest-VolumesActionsTest-175841311 None] Attach volume completed successfully. Sep 17 07:58:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-19dd97af-eea3-4ab8-ba9b-dc4afe971f30 tempest-VolumesActionsTest-175841311 None] Lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450" released by "attach_volume" :: held 0.396s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:58:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a932ac1b-f885-467a-90c3-17b69ecc604c tempest-VolumesActionsTest-175841311 None] Acquiring lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450-detach_volume" by "detach_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:58:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a932ac1b-f885-467a-90c3-17b69ecc604c tempest-VolumesActionsTest-175841311 None] Lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:58:51 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-a932ac1b-f885-467a-90c3-17b69ecc604c tempest-VolumesActionsTest-175841311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:58:51 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-a932ac1b-f885-467a-90c3-17b69ecc604c tempest-VolumesActionsTest-175841311 None] Detaching volume 8974b1f4-5592-4e4c-8096-b9dc7b41c450 from instance fa8f37fc-5cfa-49de-af90-9af5d45a88c9. Sep 17 07:58:51 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-a932ac1b-f885-467a-90c3-17b69ecc604c tempest-VolumesActionsTest-175841311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:58:51 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-a932ac1b-f885-467a-90c3-17b69ecc604c tempest-VolumesActionsTest-175841311 None] Detach volume completed successfully. Sep 17 07:58:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a932ac1b-f885-467a-90c3-17b69ecc604c tempest-VolumesActionsTest-175841311 None] Lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:59:01 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:59:01 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:59:28 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 07:59:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:59:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:59:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 07:59:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 07:59:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 07:59:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:59:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.375s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:59:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 07:59:33 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-130dbb11-4dd6-435e-a5a4-8204bb94bcf2 tempest-VolumesActionsTest-175841311 None] Acquiring lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450" by "attach_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:59:33 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-130dbb11-4dd6-435e-a5a4-8204bb94bcf2 tempest-VolumesActionsTest-175841311 None] Lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450" acquired by "attach_volume" :: waited 0.044s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:59:34 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-130dbb11-4dd6-435e-a5a4-8204bb94bcf2 tempest-VolumesActionsTest-175841311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:59:34 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-130dbb11-4dd6-435e-a5a4-8204bb94bcf2 tempest-VolumesActionsTest-175841311 None] Attaching volume 8974b1f4-5592-4e4c-8096-b9dc7b41c450 to instance 8fa2dcaa-214c-4e98-9966-8b38ab225b95 at mountpoint /dev/vdb on host None. Sep 17 07:59:34 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-130dbb11-4dd6-435e-a5a4-8204bb94bcf2 tempest-VolumesActionsTest-175841311 None] Attach volume completed successfully. Sep 17 07:59:34 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-130dbb11-4dd6-435e-a5a4-8204bb94bcf2 tempest-VolumesActionsTest-175841311 None] Lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450" released by "attach_volume" :: held 0.366s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:59:34 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-24d2a07c-98cb-4889-a1c6-c6202d746dda tempest-VolumesActionsTest-175841311 None] Acquiring lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450-detach_volume" by "detach_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 07:59:34 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-24d2a07c-98cb-4889-a1c6-c6202d746dda tempest-VolumesActionsTest-175841311 None] Lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 07:59:34 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-24d2a07c-98cb-4889-a1c6-c6202d746dda tempest-VolumesActionsTest-175841311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:59:34 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-24d2a07c-98cb-4889-a1c6-c6202d746dda tempest-VolumesActionsTest-175841311 None] Detaching volume 8974b1f4-5592-4e4c-8096-b9dc7b41c450 from instance 8fa2dcaa-214c-4e98-9966-8b38ab225b95. Sep 17 07:59:34 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-24d2a07c-98cb-4889-a1c6-c6202d746dda tempest-VolumesActionsTest-175841311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:59:34 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-24d2a07c-98cb-4889-a1c6-c6202d746dda tempest-VolumesActionsTest-175841311 None] Detach volume completed successfully. Sep 17 07:59:34 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-24d2a07c-98cb-4889-a1c6-c6202d746dda tempest-VolumesActionsTest-175841311 None] Lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 07:59:44 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:59:44 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 07:59:46 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 07:59:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 07:59:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 07:59:46 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29931de-84b6-4ea9-aede-25c7dbbb60ac]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:59:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:59:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450" returned: 0 in 0.488s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:59:47 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabdaaf7-d3f4-459d-9879-3ab439671a7c]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:59:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:59:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450" returned: 0 in 0.574s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:59:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 /opt/stack/data/cinder/conversion/8974b1f4-5592-4e4c-8096-b9dc7b41c450.temp_image.6027c76f-429e-4668-aecf-c18559fdeb598whzqpup.img {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:59:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 /opt/stack/data/cinder/conversion/8974b1f4-5592-4e4c-8096-b9dc7b41c450.temp_image.6027c76f-429e-4668-aecf-c18559fdeb598whzqpup.img" returned: 0 in 6.175s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:59:53 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbcfb93-a393-455f-ad40-2a8bb98bd172]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 07:59:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 07:59:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450" returned: 0 in 0.522s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 07:59:54 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] Image conversion details: src /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/conversion/8974b1f4-5592-4e4c-8096-b9dc7b41c450.temp_image.6027c76f-429e-4668-aecf-c18559fdeb598whzqpup.img {{(pid=83207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 07:59:54 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] Converted 1024.00 MB image at 165.25 MB/s Sep 17 07:59:54 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] 6027c76f-429e-4668-aecf-c18559fdeb59 was raw, no need to convert to raw {{(pid=83207) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}} Sep 17 08:00:06 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:00:06 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:00:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-4ec8f8fd-4daa-49ef-a89b-236d09a1a06c req-344a284c-40e3-4376-9755-da1e8270613e tempest-TestServerVolumeAttachmentScenario-1611442740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:00:34 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:00:34 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:00:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 51.729s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:00:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] Uploaded volume to glance image-id: 6027c76f-429e-4668-aecf-c18559fdeb59. {{(pid=83207) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 17 08:00:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-4ec8f8fd-4daa-49ef-a89b-236d09a1a06c req-344a284c-40e3-4376-9755-da1e8270613e tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.884s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:00:38 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9130dcf8-5c7f-46d3-82e9-21bd362d9e7b]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:00:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-4ec8f8fd-4daa-49ef-a89b-236d09a1a06c req-344a284c-40e3-4376-9755-da1e8270613e tempest-TestServerVolumeAttachmentScenario-1611442740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2e9f0739-78a9-465e-8711-84c9e8a53edd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:00:38 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-06b1764c-28bb-497e-b82f-a082f352a2df tempest-VolumesActionsTest-175841311 None] Copy volume to image completed successfully. Sep 17 08:00:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-4ec8f8fd-4daa-49ef-a89b-236d09a1a06c req-344a284c-40e3-4376-9755-da1e8270613e tempest-TestServerVolumeAttachmentScenario-1611442740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2e9f0739-78a9-465e-8711-84c9e8a53edd" returned: 0 in 0.444s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:00:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-4ec8f8fd-4daa-49ef-a89b-236d09a1a06c req-344a284c-40e3-4376-9755-da1e8270613e tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.515s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:00:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-4ec8f8fd-4daa-49ef-a89b-236d09a1a06c req-344a284c-40e3-4376-9755-da1e8270613e tempest-TestServerVolumeAttachmentScenario-1611442740 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-2e9f0739-78a9-465e-8711-84c9e8a53edd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff0a17b5-7079-44fa-9566-ac842ecb8c8d', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 08:00:38 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-4ec8f8fd-4daa-49ef-a89b-236d09a1a06c req-344a284c-40e3-4376-9755-da1e8270613e tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:00:39 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-4ec8f8fd-4daa-49ef-a89b-236d09a1a06c req-344a284c-40e3-4376-9755-da1e8270613e tempest-TestServerVolumeAttachmentScenario-1611442740 None] attachment_update completed successfully. Sep 17 08:00:39 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:00:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:00:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:00:39 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff1b401-fac9-41da-aa4e-1fb8713d9bfc]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:00:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:00:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450" returned: 0 in 0.522s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:00:40 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d81e56b-9f44-40a9-b364-a27058871267]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:00:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:00:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450" returned: 0 in 0.465s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:00:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 /opt/stack/data/cinder/conversion/8974b1f4-5592-4e4c-8096-b9dc7b41c450.temp_image.d26ff2c7-6ee1-475f-9bc6-c9bbd291a712miwrv8tu.img {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:00:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 /opt/stack/data/cinder/conversion/8974b1f4-5592-4e4c-8096-b9dc7b41c450.temp_image.d26ff2c7-6ee1-475f-9bc6-c9bbd291a712miwrv8tu.img" returned: 0 in 6.172s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:00:47 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaf7dd3-3cb8-4c7b-b049-4a7ee5e2999e]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:00:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:00:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450" returned: 0 in 0.674s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:00:47 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Image conversion details: src /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/conversion/8974b1f4-5592-4e4c-8096-b9dc7b41c450.temp_image.d26ff2c7-6ee1-475f-9bc6-c9bbd291a712miwrv8tu.img {{(pid=83207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 08:00:47 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Converted 1024.00 MB image at 165.01 MB/s Sep 17 08:00:47 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] d26ff2c7-6ee1-475f-9bc6-c9bbd291a712 was raw, converting to qcow2 {{(pid=83207) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 17 08:00:47 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f566cd4a-d2d7-4d92-a4c6-421fdcd06ff9]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:00:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8974b1f4-5592-4e4c-8096-b9dc7b41c450.temp_image.d26ff2c7-6ee1-475f-9bc6-c9bbd291a712miwrv8tu.img {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:00:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8974b1f4-5592-4e4c-8096-b9dc7b41c450.temp_image.d26ff2c7-6ee1-475f-9bc6-c9bbd291a712miwrv8tu.img" returned: 0 in 0.458s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:00:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8974b1f4-5592-4e4c-8096-b9dc7b41c450.temp_image.d26ff2c7-6ee1-475f-9bc6-c9bbd291a712miwrv8tu.img {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:00:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8974b1f4-5592-4e4c-8096-b9dc7b41c450.temp_image.d26ff2c7-6ee1-475f-9bc6-c9bbd291a712miwrv8tu.img" returned: 1 in 0.386s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:00:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8974b1f4-5592-4e4c-8096-b9dc7b41c450.temp_image.d26ff2c7-6ee1-475f-9bc6-c9bbd291a712miwrv8tu.img' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:00:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8974b1f4-5592-4e4c-8096-b9dc7b41c450.temp_image.d26ff2c7-6ee1-475f-9bc6-c9bbd291a712miwrv8tu.img /opt/stack/data/cinder/conversion/vol_upload_lr4c2jmu {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:00:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8974b1f4-5592-4e4c-8096-b9dc7b41c450.temp_image.d26ff2c7-6ee1-475f-9bc6-c9bbd291a712miwrv8tu.img /opt/stack/data/cinder/conversion/vol_upload_lr4c2jmu" returned: 0 in 0.164s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:00:49 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Image conversion details: src /opt/stack/data/cinder/conversion/8974b1f4-5592-4e4c-8096-b9dc7b41c450.temp_image.d26ff2c7-6ee1-475f-9bc6-c9bbd291a712miwrv8tu.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_lr4c2jmu {{(pid=83207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 08:00:49 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 17 08:00:49 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[af12998b-a38d-4f15-83a7-326d9014e49d]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:00:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lr4c2jmu {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:00:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lr4c2jmu" returned: 0 in 0.444s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:00:49 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=2,cinder:SELECT=6 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:00:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.164s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:00:50 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Uploaded volume to glance image-id: d26ff2c7-6ee1-475f-9bc6-c9bbd291a712. {{(pid=83207) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 17 08:00:51 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-a9c9d49f-3a82-4431-a7d7-d8b44287eb6c tempest-VolumesActionsTest-175841311 None] Copy volume to image completed successfully. Sep 17 08:00:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Acquiring lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:00:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:00:52 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:00:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Acquiring lock "cinder-quobyte-8974b1f4-5592-4e4c-8096-b9dc7b41c450" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:00:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Lock "cinder-quobyte-8974b1f4-5592-4e4c-8096-b9dc7b41c450" acquired by "delete_volume" :: waited 0.015s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:00:52 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9d724e-5343-4566-af45-43491fc691fb]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:00:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:00:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450" returned: 0 in 0.593s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:00:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:00:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8974b1f4-5592-4e4c-8096-b9dc7b41c450" returned: 0 in 0.371s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:00:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-7c6f8def-5a74-4350-8cda-cb43f5867182 req-14964972-d337-4467-bf11-b07cfbdd65df tempest-TestServerVolumeAttachmentScenario-1611442740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:00:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-7c6f8def-5a74-4350-8cda-cb43f5867182 req-14964972-d337-4467-bf11-b07cfbdd65df tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:00:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Lock "cinder-quobyte-8974b1f4-5592-4e4c-8096-b9dc7b41c450" released by "delete_volume" :: held 1.113s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:00:53 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba9ab8b-6dd7-4d3a-b293-ddf2f0fd90d6]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:00:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-7c6f8def-5a74-4350-8cda-cb43f5867182 req-14964972-d337-4467-bf11-b07cfbdd65df tempest-TestServerVolumeAttachmentScenario-1611442740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3a39d946-9739-47c0-982c-c0880ce6e050 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:00:54 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Created reservations ['56ad7d5d-4d68-496d-a835-31d84d2224e8', '8db06a01-c8b7-4aa2-a616-b251d4577d04', 'a6d7a770-416c-4a59-a337-21be42d9423b', '8ea68994-82ea-4e6c-b542-e649d0a0a5b9'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:00:54 devstack quobyte-client[83219]: System call of process 100019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:00:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:00:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:00:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:00:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:00:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:00:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:00:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-7c6f8def-5a74-4350-8cda-cb43f5867182 req-14964972-d337-4467-bf11-b07cfbdd65df tempest-TestServerVolumeAttachmentScenario-1611442740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3a39d946-9739-47c0-982c-c0880ce6e050" returned: 0 in 0.627s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:00:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-7c6f8def-5a74-4350-8cda-cb43f5867182 req-14964972-d337-4467-bf11-b07cfbdd65df tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.747s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:00:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.267s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:00:54 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:00:54 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Deleted volume successfully. Sep 17 08:00:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7496bbe4-94f7-489f-a59b-40a8ba58eea6 tempest-VolumesActionsTest-175841311 None] Lock "cinder-8974b1f4-5592-4e4c-8096-b9dc7b41c450-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:00:54 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-7c6f8def-5a74-4350-8cda-cb43f5867182 req-14964972-d337-4467-bf11-b07cfbdd65df tempest-TestServerVolumeAttachmentScenario-1611442740 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-3a39d946-9739-47c0-982c-c0880ce6e050', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b831485-8db5-45fc-bead-2487c5b8d2c4', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 08:00:54 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-7c6f8def-5a74-4350-8cda-cb43f5867182 req-14964972-d337-4467-bf11-b07cfbdd65df tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:00:55 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-7c6f8def-5a74-4350-8cda-cb43f5867182 req-14964972-d337-4467-bf11-b07cfbdd65df tempest-TestServerVolumeAttachmentScenario-1611442740 None] attachment_update completed successfully. Sep 17 08:01:03 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Flow 'volume_create_manager' (79420ebc-b97c-4e8b-a2ab-05b28cf494a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae9812b-4b91-4da2-8e94-5a150ef964af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae9812b-4b91-4da2-8e94-5a150ef964af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-844893052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad8754b-13b4-44d7-b737-af7c0f6ea0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc28b6a7a5c48c59d445f74ed471d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:04Z,use_quota=True,user_id='9efa37185d5b4a1089774d53da6d6b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d344fd60-fc2c-4510-8cd6-8ee7410703ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d344fd60-fc2c-4510-8cd6-8ee7410703ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bdcedd-2311-44e3-bfd1-f06e0cce4cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1bdcedd-2311-44e3-bfd1-f06e0cce4cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cad8754b-13b4-44d7-b737-af7c0f6ea0a1', 'volume_name': 'volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27cdd8a-a312-4a9c-bd49-5f013a7b2561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a27cdd8a-a312-4a9c-bd49-5f013a7b2561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4927bbb7-b1ce-47d2-81ed-2ea23f6aa847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:03 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume cad8754b-13b4-44d7-b737-af7c0f6ea0a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1', 'volume_size': 1} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-844893052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cad8754b-13b4-44d7-b737-af7c0f6ea0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc28b6a7a5c48c59d445f74ed471d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:04Z,use_quota=True,user_id='9efa37185d5b4a1089774d53da6d6b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Creating volume cad8754b-13b4-44d7-b737-af7c0f6ea0a1 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:01:03 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:01:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:03 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=121, name=volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:01:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1 1073741824" returned: 0 in 0.312s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1" returned: 0 in 0.076s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:04 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] <== create_volume: return (448ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:01:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.458s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4927bbb7-b1ce-47d2-81ed-2ea23f6aa847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16efcda-a712-415b-bf20-adb3002b1150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:04 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1 (cad8754b-13b4-44d7-b737-af7c0f6ea0a1): created successfully Sep 17 08:01:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16efcda-a712-415b-bf20-adb3002b1150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:04 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Flow 'volume_create_manager' (79420ebc-b97c-4e8b-a2ab-05b28cf494a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:04 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-55ff6951-ecea-4412-b76c-ddff991a5fa7 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Created volume successfully. Sep 17 08:01:05 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] Creating offline snapshot 2cda2ebe-add6-43df-9f51-99f804ddbfd0 of volume cad8754b-13b4-44d7-b737-af7c0f6ea0a1 {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 08:01:06 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36514f3-e2d3-4519-b129-3ef9ff83315b]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1" returned: 0 in 0.435s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:06 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=122, name=volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:01:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0 1G" returned: 0 in 0.224s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): qemu-img rebase -u -b volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "qemu-img rebase -u -b volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0" returned: 0 in 0.146s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 08:01:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0" returned: 0 in 0.082s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1 -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 08:01:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0" returned: 0 in 0.095s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.info" returned: 0 in 0.085s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 08:01:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.info" returned: 0 in 0.110s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.527s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:07 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-2275d93e-a5ee-4290-a310-d5b96b036d7c tempest-CreateVolumesFromSnapshotTest-1747125388 None] Create snapshot completed successfully Sep 17 08:01:08 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Flow 'volume_create_manager' (515eb04c-063d-4fb6-b6fe-58dae43c4529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e90a45-7a11-43d9-b560-ec7e0c7ff77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e90a45-7a11-43d9-b560-ec7e0c7ff77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-746842055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb27e646-4aaa-4005-84d6-aaa98dc66e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc28b6a7a5c48c59d445f74ed471d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:08Z,use_quota=True,user_id='9efa37185d5b4a1089774d53da6d6b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20342603-a99d-4f72-baa9-3d55ffd792e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20342603-a99d-4f72-baa9-3d55ffd792e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20893b12-f544-4eaf-954d-bb1ea7588f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20893b12-f544-4eaf-954d-bb1ea7588f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb27e646-4aaa-4005-84d6-aaa98dc66e44', 'volume_name': 'volume-cb27e646-4aaa-4005-84d6-aaa98dc66e44', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3413f691-f6fc-42f4-a385-f7921cb29fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3413f691-f6fc-42f4-a385-f7921cb29fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98d6465-e275-4493-bee2-4bb65045b915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:08 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume cb27e646-4aaa-4005-84d6-aaa98dc66e44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb27e646-4aaa-4005-84d6-aaa98dc66e44', 'volume_size': 1} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-746842055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb27e646-4aaa-4005-84d6-aaa98dc66e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc28b6a7a5c48c59d445f74ed471d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:08Z,use_quota=True,user_id='9efa37185d5b4a1089774d53da6d6b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Creating volume cb27e646-4aaa-4005-84d6-aaa98dc66e44 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:01:08 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:01:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cb27e646-4aaa-4005-84d6-aaa98dc66e44 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:09 devstack quobyte-client[83219]: System call of process 100088 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:01:09 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=124, name=volume-cb27e646-4aaa-4005-84d6-aaa98dc66e44, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:01:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cb27e646-4aaa-4005-84d6-aaa98dc66e44 1073741824" returned: 0 in 0.853s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cb27e646-4aaa-4005-84d6-aaa98dc66e44 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:10 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Flow 'volume_create_manager' (b9526583-d713-448d-99af-1c726cb477df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e218f7e8-cac8-40ee-8a69-9d4ad5b8d02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cb27e646-4aaa-4005-84d6-aaa98dc66e44" returned: 0 in 0.881s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] <== create_volume: return (1799ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e218f7e8-cac8-40ee-8a69-9d4ad5b8d02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1453513935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed90c28-6cc6-4047-b1af-62fe63d1ae08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc28b6a7a5c48c59d445f74ed471d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:09Z,use_quota=True,user_id='9efa37185d5b4a1089774d53da6d6b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467562d1-baf3-4665-ac9d-eee782a2255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467562d1-baf3-4665-ac9d-eee782a2255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998075db-d0b4-4fc6-801e-4e5306c044d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998075db-d0b4-4fc6-801e-4e5306c044d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ed90c28-6cc6-4047-b1af-62fe63d1ae08', 'volume_name': 'volume-8ed90c28-6cc6-4047-b1af-62fe63d1ae08', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b99dd4f-755b-4fc0-8011-e027eebccf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b99dd4f-755b-4fc0-8011-e027eebccf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d4b6be-99bf-4361-b181-6efec525ef08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:10 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume 8ed90c28-6cc6-4047-b1af-62fe63d1ae08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ed90c28-6cc6-4047-b1af-62fe63d1ae08', 'volume_size': 1} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1453513935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed90c28-6cc6-4047-b1af-62fe63d1ae08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc28b6a7a5c48c59d445f74ed471d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:09Z,use_quota=True,user_id='9efa37185d5b4a1089774d53da6d6b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Creating volume 8ed90c28-6cc6-4047-b1af-62fe63d1ae08 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:01:10 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:01:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8ed90c28-6cc6-4047-b1af-62fe63d1ae08 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:10 devstack quobyte-client[83219]: System call of process 100094 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:01:10 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=125, name=volume-8ed90c28-6cc6-4047-b1af-62fe63d1ae08, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:01:11 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Flow 'volume_create_manager' (c09360e1-839e-4f86-830f-cc390508a9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2352851-d6bd-442a-b8ec-6a25d13318bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:11 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Flow 'volume_create_manager' (b1655889-5307-4d0f-9ba5-0e9994c79909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b80e84-154a-41c8-b5be-384e0d9813d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2352851-d6bd-442a-b8ec-6a25d13318bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-223769370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7adc3b-c250-4cce-a5a4-1d96d0b560b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc28b6a7a5c48c59d445f74ed471d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:10Z,use_quota=True,user_id='9efa37185d5b4a1089774d53da6d6b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1678e01-40df-4d2a-b914-0137bf52a8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1678e01-40df-4d2a-b914-0137bf52a8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1948e4b3-6741-45c5-852d-beea2afe4ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1948e4b3-6741-45c5-852d-beea2afe4ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7adc3b-c250-4cce-a5a4-1d96d0b560b6', 'volume_name': 'volume-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f16d8f-b936-41f1-a336-9aa55ed1f7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f16d8f-b936-41f1-a336-9aa55ed1f7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455bd2a2-d31e-4548-8b6e-4ca99e13306f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:11 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume 3b7adc3b-c250-4cce-a5a4-1d96d0b560b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6', 'volume_size': 1} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8ed90c28-6cc6-4047-b1af-62fe63d1ae08 1073741824" returned: 0 in 0.874s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8ed90c28-6cc6-4047-b1af-62fe63d1ae08 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b80e84-154a-41c8-b5be-384e0d9813d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-373785705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0de2df-265d-450d-b5e0-9a18c10a8776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc28b6a7a5c48c59d445f74ed471d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:10Z,use_quota=True,user_id='9efa37185d5b4a1089774d53da6d6b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bf8c2a-6462-4d9e-aab4-075ed4a6d9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6bf8c2a-6462-4d9e-aab4-075ed4a6d9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59dd79f9-d3b3-446a-b847-4fb0fb9e03ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59dd79f9-d3b3-446a-b847-4fb0fb9e03ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c0de2df-265d-450d-b5e0-9a18c10a8776', 'volume_name': 'volume-1c0de2df-265d-450d-b5e0-9a18c10a8776', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81652667-bcfe-4c50-9cad-647cd38e6176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81652667-bcfe-4c50-9cad-647cd38e6176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba69c57-a868-467b-842c-5b8ed2a3b9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:11 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume 1c0de2df-265d-450d-b5e0-9a18c10a8776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c0de2df-265d-450d-b5e0-9a18c10a8776', 'volume_size': 1} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98d6465-e275-4493-bee2-4bb65045b915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb27e646-4aaa-4005-84d6-aaa98dc66e44', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5b2c33-3a5b-41e4-8ef8-3e2555c9c38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8ed90c28-6cc6-4047-b1af-62fe63d1ae08" returned: 0 in 0.517s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] <== create_volume: return (1414ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.576s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-223769370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7adc3b-c250-4cce-a5a4-1d96d0b560b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc28b6a7a5c48c59d445f74ed471d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:10Z,use_quota=True,user_id='9efa37185d5b4a1089774d53da6d6b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Creating volume 3b7adc3b-c250-4cce-a5a4-1d96d0b560b6 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:01:12 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:12 devstack quobyte-client[83219]: System call of process 100098 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:01:12 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume volume-cb27e646-4aaa-4005-84d6-aaa98dc66e44 (cb27e646-4aaa-4005-84d6-aaa98dc66e44): created successfully Sep 17 08:01:12 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=126, name=volume-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5b2c33-3a5b-41e4-8ef8-3e2555c9c38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Flow 'volume_create_manager' (515eb04c-063d-4fb6-b6fe-58dae43c4529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d4b6be-99bf-4361-b181-6efec525ef08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed90c28-6cc6-4047-b1af-62fe63d1ae08', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdb40f6-696a-416a-ad22-0117e4003425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:12 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Flow 'volume_create_manager' (4605b67b-a694-45c2-9bd1-c72a48c93884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4e0502-49cf-4b6a-963b-2649a18599ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4e0502-49cf-4b6a-963b-2649a18599ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-383093004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c514ce-9d28-4943-8343-052fe4398f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc28b6a7a5c48c59d445f74ed471d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:11Z,use_quota=True,user_id='9efa37185d5b4a1089774d53da6d6b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac98b33e-943b-43e3-9252-f0fcb9596647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac98b33e-943b-43e3-9252-f0fcb9596647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb80a85-fa91-4df9-9b7d-b25d16698ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb80a85-fa91-4df9-9b7d-b25d16698ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c514ce-9d28-4943-8343-052fe4398f1c', 'volume_name': 'volume-67c514ce-9d28-4943-8343-052fe4398f1c', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f813f2e-c55d-4b0e-b40c-8265f33557ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f813f2e-c55d-4b0e-b40c-8265f33557ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f16bb6-503d-4c1e-8477-e86acd642553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:12 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume 67c514ce-9d28-4943-8343-052fe4398f1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c514ce-9d28-4943-8343-052fe4398f1c', 'volume_size': 1} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:12 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-66aec49e-cb37-4af7-b6d7-ecc9c39bc4e9 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Created volume successfully. Sep 17 08:01:12 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume volume-8ed90c28-6cc6-4047-b1af-62fe63d1ae08 (8ed90c28-6cc6-4047-b1af-62fe63d1ae08): created successfully Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdb40f6-696a-416a-ad22-0117e4003425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Flow 'volume_create_manager' (b9526583-d713-448d-99af-1c726cb477df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6 1073741824" returned: 0 in 0.642s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:12 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e079a24b-1173-4de7-9067-046d83b42835 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Created volume successfully. Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6" returned: 0 in 0.257s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] <== create_volume: return (924ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.125s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-373785705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0de2df-265d-450d-b5e0-9a18c10a8776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc28b6a7a5c48c59d445f74ed471d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:10Z,use_quota=True,user_id='9efa37185d5b4a1089774d53da6d6b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Creating volume 1c0de2df-265d-450d-b5e0-9a18c10a8776 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:01:13 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c0de2df-265d-450d-b5e0-9a18c10a8776 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:13 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=127, name=volume-1c0de2df-265d-450d-b5e0-9a18c10a8776, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455bd2a2-d31e-4548-8b6e-4ca99e13306f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4c1da5-203d-427b-a7b1-c69718420d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c0de2df-265d-450d-b5e0-9a18c10a8776 1073741824" returned: 0 in 0.382s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c0de2df-265d-450d-b5e0-9a18c10a8776 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:13 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume volume-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6 (3b7adc3b-c250-4cce-a5a4-1d96d0b560b6): created successfully Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4c1da5-203d-427b-a7b1-c69718420d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Flow 'volume_create_manager' (c09360e1-839e-4f86-830f-cc390508a9df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c0de2df-265d-450d-b5e0-9a18c10a8776" returned: 0 in 0.378s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] <== create_volume: return (793ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.139s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-383093004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c514ce-9d28-4943-8343-052fe4398f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc28b6a7a5c48c59d445f74ed471d5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:11Z,use_quota=True,user_id='9efa37185d5b4a1089774d53da6d6b1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Creating volume 67c514ce-9d28-4943-8343-052fe4398f1c {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:01:13 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:01:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-67c514ce-9d28-4943-8343-052fe4398f1c 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:14 devstack quobyte-client[83219]: System call of process 100106 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:01:14 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=128, name=volume-67c514ce-9d28-4943-8343-052fe4398f1c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:01:14 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b737acd9-a0a1-42e5-b07e-22006b5cd79a tempest-CreateVolumesFromSnapshotTest-1747125388 None] Created volume successfully. Sep 17 08:01:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba69c57-a868-467b-842c-5b8ed2a3b9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c0de2df-265d-450d-b5e0-9a18c10a8776', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88773caf-f685-4346-aefb-0d0fee396a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-67c514ce-9d28-4943-8343-052fe4398f1c 1073741824" returned: 0 in 0.411s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-67c514ce-9d28-4943-8343-052fe4398f1c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:14 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume volume-1c0de2df-265d-450d-b5e0-9a18c10a8776 (1c0de2df-265d-450d-b5e0-9a18c10a8776): created successfully Sep 17 08:01:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88773caf-f685-4346-aefb-0d0fee396a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Flow 'volume_create_manager' (b1655889-5307-4d0f-9ba5-0e9994c79909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-67c514ce-9d28-4943-8343-052fe4398f1c" returned: 0 in 0.291s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] <== create_volume: return (725ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:01:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:14 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-16eb9783-6437-4320-94ba-04a4d75f9ec0 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Created volume successfully. Sep 17 08:01:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f16bb6-503d-4c1e-8477-e86acd642553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c514ce-9d28-4943-8343-052fe4398f1c', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47830d35-54f6-40d1-8034-70db8cc47c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:14 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume volume-67c514ce-9d28-4943-8343-052fe4398f1c (67c514ce-9d28-4943-8343-052fe4398f1c): created successfully Sep 17 08:01:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47830d35-54f6-40d1-8034-70db8cc47c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Flow 'volume_create_manager' (4605b67b-a694-45c2-9bd1-c72a48c93884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:14 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-6b5fe49a-b232-45f7-aba4-23761b7bd5e6 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Created volume successfully. Sep 17 08:01:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-67c514ce-9d28-4943-8343-052fe4398f1c-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-67c514ce-9d28-4943-8343-052fe4398f1c-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:15 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-quobyte-67c514ce-9d28-4943-8343-052fe4398f1c" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-67c514ce-9d28-4943-8343-052fe4398f1c" acquired by "delete_volume" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:15 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6493fb4b-75b2-43cb-a801-f7d93f1ff157]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-67c514ce-9d28-4943-8343-052fe4398f1c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-67c514ce-9d28-4943-8343-052fe4398f1c" returned: 0 in 0.390s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-67c514ce-9d28-4943-8343-052fe4398f1c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-67c514ce-9d28-4943-8343-052fe4398f1c" returned: 0 in 0.119s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:16 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-67c514ce-9d28-4943-8343-052fe4398f1c" released by "delete_volume" :: held 0.657s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:16 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Created reservations ['e9852a8a-59a1-415a-abdb-2580e6569fe0', '6167a7b0-c7d3-4f4a-9f24-d3599700979e', '2207d7cc-d3d0-4112-9127-8e43ef8b8ff4', 'c61b8589-a26e-4eac-b4d8-e46ad444729c'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:01:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.102s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:16 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:01:16 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Deleted volume successfully. Sep 17 08:01:16 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1752056e-a60d-47d6-99b3-572ba6bf4251 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-67c514ce-9d28-4943-8343-052fe4398f1c-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-1c0de2df-265d-450d-b5e0-9a18c10a8776-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-1c0de2df-265d-450d-b5e0-9a18c10a8776-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:17 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-quobyte-1c0de2df-265d-450d-b5e0-9a18c10a8776" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-1c0de2df-265d-450d-b5e0-9a18c10a8776" acquired by "delete_volume" :: waited 0.015s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:17 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba72329b-c6c3-49c1-90d8-4db56b8cd803]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c0de2df-265d-450d-b5e0-9a18c10a8776 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c0de2df-265d-450d-b5e0-9a18c10a8776" returned: 0 in 0.403s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c0de2df-265d-450d-b5e0-9a18c10a8776 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1c0de2df-265d-450d-b5e0-9a18c10a8776" returned: 0 in 0.083s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-1c0de2df-265d-450d-b5e0-9a18c10a8776" released by "delete_volume" :: held 0.659s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:18 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Created reservations ['857ebf2a-a692-40f0-ba16-6342399f1291', 'a16a8528-89c2-4980-8d2a-f7ff908e0527', '3b2b43c5-10c1-43ef-88ed-048831d7a4dd', '74f89c8e-a908-4284-9d86-17448ee66b73'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:01:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.080s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:18 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:01:19 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Deleted volume successfully. Sep 17 08:01:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e3a98c16-0613-4339-8b84-d7c6df357790 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-1c0de2df-265d-450d-b5e0-9a18c10a8776-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:19 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-quobyte-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6" acquired by "delete_volume" :: waited 0.016s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:19 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d351c3a6-ce69-4e7e-b1ae-0fa985d393d2]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6" returned: 0 in 0.406s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6" returned: 0 in 0.083s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:20 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6" released by "delete_volume" :: held 0.679s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:20 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Created reservations ['3bab6e98-cf76-475c-b3cc-6d37ea9215b5', '3f238601-7eb0-47ef-9832-e000fe166385', 'ff2b9503-757a-44d2-b54c-8369f6a93f00', 'f8a1ad97-b6e5-4c4e-a641-5788b9758928'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:01:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:21 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:21 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.089s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:21 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:01:21 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Deleted volume successfully. Sep 17 08:01:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-761b603b-8543-45a8-9746-9ddc62d8ea78 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-3b7adc3b-c250-4cce-a5a4-1d96d0b560b6-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-8ed90c28-6cc6-4047-b1af-62fe63d1ae08-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-8ed90c28-6cc6-4047-b1af-62fe63d1ae08-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:22 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-quobyte-8ed90c28-6cc6-4047-b1af-62fe63d1ae08" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-8ed90c28-6cc6-4047-b1af-62fe63d1ae08" acquired by "delete_volume" :: waited 0.010s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:22 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f000614e-a6d7-49f5-9ef8-9d5b7b87b055]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8ed90c28-6cc6-4047-b1af-62fe63d1ae08 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8ed90c28-6cc6-4047-b1af-62fe63d1ae08" returned: 0 in 0.431s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8ed90c28-6cc6-4047-b1af-62fe63d1ae08 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-8ed90c28-6cc6-4047-b1af-62fe63d1ae08" returned: 0 in 0.092s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-8ed90c28-6cc6-4047-b1af-62fe63d1ae08" released by "delete_volume" :: held 0.666s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:23 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Created reservations ['9f482cd5-d073-4402-ae0f-190c00ebed96', '57a4cf58-d252-4db0-bf9f-281343551691', 'afa9f125-c7a2-4840-8e01-76728b67f05d', '554e9e64-9ec8-4af6-8d57-22bdc0d72002'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:01:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.091s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:23 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:01:23 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Deleted volume successfully. Sep 17 08:01:23 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-17106bdd-92d4-43cd-936c-b64b673dd367 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-8ed90c28-6cc6-4047-b1af-62fe63d1ae08-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:23 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-99dcec04-7775-4c5a-bd84-a57e65117378 req-598727f8-7738-41bb-a40d-37b42d35522b tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:23 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-99dcec04-7775-4c5a-bd84-a57e65117378 req-598727f8-7738-41bb-a40d-37b42d35522b tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:23 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-99dcec04-7775-4c5a-bd84-a57e65117378 req-598727f8-7738-41bb-a40d-37b42d35522b tempest-TestServerVolumeAttachmentScenario-1611442740 None] Terminate volume connection completed successfully. Sep 17 08:01:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-99dcec04-7775-4c5a-bd84-a57e65117378 req-598727f8-7738-41bb-a40d-37b42d35522b tempest-TestServerVolumeAttachmentScenario-1611442740 None] Deleting attachment 7b831485-8db5-45fc-bead-2487c5b8d2c4. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 08:01:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-cb27e646-4aaa-4005-84d6-aaa98dc66e44-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-cb27e646-4aaa-4005-84d6-aaa98dc66e44-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:24 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-quobyte-cb27e646-4aaa-4005-84d6-aaa98dc66e44" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-cb27e646-4aaa-4005-84d6-aaa98dc66e44" acquired by "delete_volume" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:24 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a986d676-0bcb-4a63-904f-26ac9f5b1168]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cb27e646-4aaa-4005-84d6-aaa98dc66e44 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cb27e646-4aaa-4005-84d6-aaa98dc66e44" returned: 0 in 0.423s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cb27e646-4aaa-4005-84d6-aaa98dc66e44 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cb27e646-4aaa-4005-84d6-aaa98dc66e44" returned: 0 in 0.105s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:25 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-cb27e646-4aaa-4005-84d6-aaa98dc66e44" released by "delete_volume" :: held 0.680s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:25 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Created reservations ['0320786e-a312-41c1-8bb2-2472122f71d7', '0cf4a4bb-bdaf-4235-8273-4c03a09baac8', 'c124e128-f676-4176-8e19-24334449c134', 'dc56202a-69ec-46b1-a909-1d53a8eb7ef6'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:01:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.096s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:25 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:01:25 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Deleted volume successfully. Sep 17 08:01:25 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-875afbf5-9e6e-44d1-89d5-e4c534571694 tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-cb27e646-4aaa-4005-84d6-aaa98dc66e44-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-2cda2ebe-add6-43df-9f51-99f804ddbfd0-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-2cda2ebe-add6-43df-9f51-99f804ddbfd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:26 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-quobyte-cad8754b-13b4-44d7-b737-af7c0f6ea0a1" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-cad8754b-13b4-44d7-b737-af7c0f6ea0a1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-quobyte-2cda2ebe-add6-43df-9f51-99f804ddbfd0" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-2cda2ebe-add6-43df-9f51-99f804ddbfd0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Deleting offline snapshot 2cda2ebe-add6-43df-9f51-99f804ddbfd0 of volume cad8754b-13b4-44d7-b737-af7c0f6ea0a1 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 08:01:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] snapshot_file for this snap is: volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 08:01:26 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9f165b-0058-4bc7-a4b7-7c699d30e0dd]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0" returned: 0 in 0.410s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 08:01:27 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[76423d26-f125-4c34-9858-d7d136f8d96c]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1" returned: 0 in 0.426s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0" returned: 0 in 0.395s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.223s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1.2cda2ebe-add6-43df-9f51-99f804ddbfd0" returned: 0 in 0.195s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-2cda2ebe-add6-43df-9f51-99f804ddbfd0" released by "_delete_snapshot" :: held 1.731s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-cad8754b-13b4-44d7-b737-af7c0f6ea0a1" released by "delete_snapshot" :: held 1.765s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Created reservations ['26501ca3-d175-41fe-90fa-a3eaa0e7a1ef', '0103057a-e0a0-4cea-be9b-5218ff380425', 'e0c21d27-9fd2-4fb8-81da-bb2ebc7d1f79', 'a0b76ece-6213-4397-974e-8eb93d2026ae'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:01:28 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Delete snapshot completed successfully. Sep 17 08:01:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-cb703726-65e5-4e5b-a8a7-b5d99ca8466f tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-2cda2ebe-add6-43df-9f51-99f804ddbfd0-delete_snapshot" released by "delete_snapshot" :: held 2.243s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-cad8754b-13b4-44d7-b737-af7c0f6ea0a1-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-cad8754b-13b4-44d7-b737-af7c0f6ea0a1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:29 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "cinder-quobyte-cad8754b-13b4-44d7-b737-af7c0f6ea0a1" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:30 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-cad8754b-13b4-44d7-b737-af7c0f6ea0a1" acquired by "delete_volume" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:30 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a054b24c-0e99-4fb7-869e-e598dbb23bb2]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1" returned: 0 in 0.413s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cad8754b-13b4-44d7-b737-af7c0f6ea0a1" returned: 0 in 0.115s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:30 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-quobyte-cad8754b-13b4-44d7-b737-af7c0f6ea0a1" released by "delete_volume" :: held 0.673s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:30 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Created reservations ['e36b6e66-e90e-4379-b334-1012e3f8df9b', 'f979c996-0ecb-4955-83d3-0c7078c04391', '52b00d3c-b4d1-4474-83e4-9de0959ead17', '10a1158a-4f72-43c0-aa23-00f0205b31cc'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:01:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.211s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:31 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:01:31 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Deleted volume successfully. Sep 17 08:01:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9103e390-c0fa-4a27-9047-030b420ed2ca tempest-CreateVolumesFromSnapshotTest-1747125388 None] Lock "cinder-cad8754b-13b4-44d7-b737-af7c0f6ea0a1-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:34 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=68,cinder:UPDATE=75,cinder:INSERT=18,cinder:DELETE=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:01:34 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:34 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Flow 'volume_create_manager' (2b9887e4-2f79-40fa-a5e3-5fde1f32071e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7313f3f-2aac-4d84-8f8e-fc66c30f8c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7313f3f-2aac-4d84-8f8e-fc66c30f8c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1449182645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21190a26-5751-4b27-aa0e-b813f72d6a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea2ab8d933d4b7c90815e5ad5497920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:35Z,use_quota=True,user_id='82ff02ef6db94b51a76736090faaf8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f87a5b1-fc06-4d88-ba88-a12fd467d5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f87a5b1-fc06-4d88-ba88-a12fd467d5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a26979-8a2a-422c-ac0a-3502f7f5e440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a26979-8a2a-422c-ac0a-3502f7f5e440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21190a26-5751-4b27-aa0e-b813f72d6a80', 'volume_name': 'volume-21190a26-5751-4b27-aa0e-b813f72d6a80', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b22a115f-6b76-4d0e-8cfe-eeb5b7f6d1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b22a115f-6b76-4d0e-8cfe-eeb5b7f6d1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a490b3ff-548b-4bb2-bc44-57c6804ce0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:35 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume 21190a26-5751-4b27-aa0e-b813f72d6a80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21190a26-5751-4b27-aa0e-b813f72d6a80', 'volume_size': 1} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1449182645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21190a26-5751-4b27-aa0e-b813f72d6a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea2ab8d933d4b7c90815e5ad5497920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:35Z,use_quota=True,user_id='82ff02ef6db94b51a76736090faaf8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Creating volume 21190a26-5751-4b27-aa0e-b813f72d6a80 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:01:35 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-21190a26-5751-4b27-aa0e-b813f72d6a80 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:35 devstack quobyte-client[83219]: System call of process 100192 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:01:35 devstack quobyte-client[83219]: System call of process 100192 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:01:35 devstack quobyte-client[83219]: System call of process 100192 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:01:35 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=129, name=volume-21190a26-5751-4b27-aa0e-b813f72d6a80, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-21190a26-5751-4b27-aa0e-b813f72d6a80 1073741824" returned: 0 in 0.340s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-21190a26-5751-4b27-aa0e-b813f72d6a80 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-21190a26-5751-4b27-aa0e-b813f72d6a80" returned: 0 in 0.149s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] <== create_volume: return (545ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.556s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a490b3ff-548b-4bb2-bc44-57c6804ce0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21190a26-5751-4b27-aa0e-b813f72d6a80', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901b268c-82ca-4b63-8c07-2a5660673a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:35 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume volume-21190a26-5751-4b27-aa0e-b813f72d6a80 (21190a26-5751-4b27-aa0e-b813f72d6a80): created successfully Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901b268c-82ca-4b63-8c07-2a5660673a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:35 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Flow 'volume_create_manager' (2b9887e4-2f79-40fa-a5e3-5fde1f32071e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:35 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-430050b0-ff9a-4336-8858-ac7069c821e2 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Created volume successfully. Sep 17 08:01:37 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Flow 'volume_create_manager' (df2c5c05-8535-4381-8405-8999a481adf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9b81f3-9b60-4600-86fe-3f31378cd71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb9b81f3-9b60-4600-86fe-3f31378cd71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-375746314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1126157-2f41-4f73-9736-630853e867ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea2ab8d933d4b7c90815e5ad5497920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:37Z,use_quota=True,user_id='82ff02ef6db94b51a76736090faaf8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09673138-1280-4824-85ee-86823b217277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09673138-1280-4824-85ee-86823b217277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c998cf6c-b4d6-4e49-ae46-65f5f1a44a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c998cf6c-b4d6-4e49-ae46-65f5f1a44a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1126157-2f41-4f73-9736-630853e867ac', 'volume_name': 'volume-b1126157-2f41-4f73-9736-630853e867ac', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4c27e8-b557-43a9-891a-3491f31df5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4c27e8-b557-43a9-891a-3491f31df5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfed2b2-a25d-4c2b-8355-629e14bbbc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:37 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume b1126157-2f41-4f73-9736-630853e867ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1126157-2f41-4f73-9736-630853e867ac', 'volume_size': 1} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-375746314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1126157-2f41-4f73-9736-630853e867ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea2ab8d933d4b7c90815e5ad5497920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:37Z,use_quota=True,user_id='82ff02ef6db94b51a76736090faaf8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Creating volume b1126157-2f41-4f73-9736-630853e867ac {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:01:37 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:01:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b1126157-2f41-4f73-9736-630853e867ac 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:37 devstack quobyte-client[83219]: System call of process 100196 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:01:37 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=130, name=volume-b1126157-2f41-4f73-9736-630853e867ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:01:38 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Flow 'volume_create_manager' (e5905917-128e-42b8-9cf3-036555f0da63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e490d680-dc9c-4579-aef2-f4f8f95c3cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b1126157-2f41-4f73-9736-630853e867ac 1073741824" returned: 0 in 0.665s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b1126157-2f41-4f73-9736-630853e867ac {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e490d680-dc9c-4579-aef2-f4f8f95c3cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1305827540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa050dea-cc66-4d5d-b0cd-a0b00d6052f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea2ab8d933d4b7c90815e5ad5497920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:38Z,use_quota=True,user_id='82ff02ef6db94b51a76736090faaf8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9092619-b68f-4fbb-9df0-98a147560585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9092619-b68f-4fbb-9df0-98a147560585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdf534d-532c-4bbd-850e-c50f7811f8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdf534d-532c-4bbd-850e-c50f7811f8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa050dea-cc66-4d5d-b0cd-a0b00d6052f1', 'volume_name': 'volume-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5bda6e-bc58-4de3-9381-faa471e0c0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5bda6e-bc58-4de3-9381-faa471e0c0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce2d5d3-a3b4-4b02-875a-03f541974411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:38 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume aa050dea-cc66-4d5d-b0cd-a0b00d6052f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1', 'volume_size': 1} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b1126157-2f41-4f73-9736-630853e867ac" returned: 0 in 0.506s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] <== create_volume: return (1200ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.206s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1305827540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa050dea-cc66-4d5d-b0cd-a0b00d6052f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea2ab8d933d4b7c90815e5ad5497920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:38Z,use_quota=True,user_id='82ff02ef6db94b51a76736090faaf8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Creating volume aa050dea-cc66-4d5d-b0cd-a0b00d6052f1 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:01:38 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:01:38 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:39 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=131, name=volume-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:01:39 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Flow 'volume_create_manager' (2afa0bec-6781-4d86-acb4-4c696d29caef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848780dc-2d45-4c73-8bc5-a2c9d62631fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddfed2b2-a25d-4c2b-8355-629e14bbbc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1126157-2f41-4f73-9736-630853e867ac', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c100eae8-99cc-4c66-b9d6-ae8e4eaa2f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:39 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Flow 'volume_create_manager' (b7ea2071-4ce3-4525-b0ef-ea193f12078a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b676f93-2d33-46fc-8b10-dec912cdf2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848780dc-2d45-4c73-8bc5-a2c9d62631fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1522193956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979fec26-5248-4f72-ba33-e44975b76d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea2ab8d933d4b7c90815e5ad5497920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:38Z,use_quota=True,user_id='82ff02ef6db94b51a76736090faaf8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3047f2-f500-40f6-994f-b7aa413abdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c3047f2-f500-40f6-994f-b7aa413abdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71720b13-030d-42e6-9788-d89850e0f257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71720b13-030d-42e6-9788-d89850e0f257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '979fec26-5248-4f72-ba33-e44975b76d5d', 'volume_name': 'volume-979fec26-5248-4f72-ba33-e44975b76d5d', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7cd04d-6652-4651-9188-b330246a1adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7cd04d-6652-4651-9188-b330246a1adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9067c183-9a7b-4d1a-a66e-f7a386b1d133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:39 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume 979fec26-5248-4f72-ba33-e44975b76d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-979fec26-5248-4f72-ba33-e44975b76d5d', 'volume_size': 1} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1 1073741824" returned: 0 in 0.777s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b676f93-2d33-46fc-8b10-dec912cdf2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-530454972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fa3a71-473e-47c1-9745-5a70b9c08ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea2ab8d933d4b7c90815e5ad5497920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:39Z,use_quota=True,user_id='82ff02ef6db94b51a76736090faaf8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89119776-c9f0-46ad-a91b-48a14dfd88cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89119776-c9f0-46ad-a91b-48a14dfd88cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043d80d0-790a-4bad-8b7f-81aa68d1099a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043d80d0-790a-4bad-8b7f-81aa68d1099a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68fa3a71-473e-47c1-9745-5a70b9c08ec2', 'volume_name': 'volume-68fa3a71-473e-47c1-9745-5a70b9c08ec2', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132c74ae-3688-4d8f-9156-3fb61d5976ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132c74ae-3688-4d8f-9156-3fb61d5976ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b000969-adcb-4684-a037-f88eb355c82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:39 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume 68fa3a71-473e-47c1-9745-5a70b9c08ec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68fa3a71-473e-47c1-9745-5a70b9c08ec2', 'volume_size': 1} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:39 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume volume-b1126157-2f41-4f73-9736-630853e867ac (b1126157-2f41-4f73-9736-630853e867ac): created successfully Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c100eae8-99cc-4c66-b9d6-ae8e4eaa2f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Flow 'volume_create_manager' (df2c5c05-8535-4381-8405-8999a481adf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:40 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Flow 'volume_create_manager' (030ef668-33fd-4331-be6a-db2e078940aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af161901-441a-49f1-8cde-54631311adaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1" returned: 0 in 0.532s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] <== create_volume: return (1372ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:40 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-8120e808-626c-4f68-a81e-89b5770ff9cd tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Created volume successfully. Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.593s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1522193956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=979fec26-5248-4f72-ba33-e44975b76d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea2ab8d933d4b7c90815e5ad5497920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:38Z,use_quota=True,user_id='82ff02ef6db94b51a76736090faaf8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Creating volume 979fec26-5248-4f72-ba33-e44975b76d5d {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:01:40 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-979fec26-5248-4f72-ba33-e44975b76d5d 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:40 devstack quobyte-client[83219]: System call of process 100204 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:01:40 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=132, name=volume-979fec26-5248-4f72-ba33-e44975b76d5d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af161901-441a-49f1-8cde-54631311adaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-130148367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d870753-f6aa-4671-8ebb-53f23683fcfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea2ab8d933d4b7c90815e5ad5497920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:39Z,use_quota=True,user_id='82ff02ef6db94b51a76736090faaf8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842b0eb7-e3c3-496c-ac32-f850204cd05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842b0eb7-e3c3-496c-ac32-f850204cd05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133e9899-71ed-4f3a-a1f9-cd46188dce82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133e9899-71ed-4f3a-a1f9-cd46188dce82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d870753-f6aa-4671-8ebb-53f23683fcfc', 'volume_name': 'volume-1d870753-f6aa-4671-8ebb-53f23683fcfc', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480583de-4915-41b1-8c26-ee7ad9c1609e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480583de-4915-41b1-8c26-ee7ad9c1609e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052f2dae-2dfe-4cb4-ab50-b82b93691d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:40 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume 1d870753-f6aa-4671-8ebb-53f23683fcfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d870753-f6aa-4671-8ebb-53f23683fcfc', 'volume_size': 1} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ce2d5d3-a3b4-4b02-875a-03f541974411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4131f057-391b-4ea9-96a0-9c84a423ebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-979fec26-5248-4f72-ba33-e44975b76d5d 1073741824" returned: 0 in 0.439s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-979fec26-5248-4f72-ba33-e44975b76d5d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:40 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume volume-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1 (aa050dea-cc66-4d5d-b0cd-a0b00d6052f1): created successfully Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4131f057-391b-4ea9-96a0-9c84a423ebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Flow 'volume_create_manager' (e5905917-128e-42b8-9cf3-036555f0da63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-979fec26-5248-4f72-ba33-e44975b76d5d" returned: 0 in 0.316s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] <== create_volume: return (776ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:01:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.359s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-530454972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fa3a71-473e-47c1-9745-5a70b9c08ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea2ab8d933d4b7c90815e5ad5497920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:39Z,use_quota=True,user_id='82ff02ef6db94b51a76736090faaf8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Creating volume 68fa3a71-473e-47c1-9745-5a70b9c08ec2 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:01:41 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-68fa3a71-473e-47c1-9745-5a70b9c08ec2 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:41 devstack quobyte-client[83219]: System call of process 100208 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:01:41 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=133, name=volume-68fa3a71-473e-47c1-9745-5a70b9c08ec2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:01:41 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-31e23379-4f0f-4f46-87ea-8cf943794497 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Created volume successfully. Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9067c183-9a7b-4d1a-a66e-f7a386b1d133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979fec26-5248-4f72-ba33-e44975b76d5d', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb9c3d8-e7ba-479a-a53e-c98dd81376b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-68fa3a71-473e-47c1-9745-5a70b9c08ec2 1073741824" returned: 0 in 0.558s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-68fa3a71-473e-47c1-9745-5a70b9c08ec2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:41 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume volume-979fec26-5248-4f72-ba33-e44975b76d5d (979fec26-5248-4f72-ba33-e44975b76d5d): created successfully Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb9c3d8-e7ba-479a-a53e-c98dd81376b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Flow 'volume_create_manager' (2afa0bec-6781-4d86-acb4-4c696d29caef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-68fa3a71-473e-47c1-9745-5a70b9c08ec2" returned: 0 in 0.300s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] <== create_volume: return (883ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.407s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-130148367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d870753-f6aa-4671-8ebb-53f23683fcfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea2ab8d933d4b7c90815e5ad5497920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:01:39Z,use_quota=True,user_id='82ff02ef6db94b51a76736090faaf8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Creating volume 1d870753-f6aa-4671-8ebb-53f23683fcfc {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:01:41 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:01:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1d870753-f6aa-4671-8ebb-53f23683fcfc 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:42 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-589e69d8-8810-4505-977d-81843eff49ff tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Created volume successfully. Sep 17 08:01:42 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=134, name=volume-1d870753-f6aa-4671-8ebb-53f23683fcfc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:01:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b000969-adcb-4684-a037-f88eb355c82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68fa3a71-473e-47c1-9745-5a70b9c08ec2', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81701b10-2847-4664-8200-c1559be4b51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:42 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume volume-68fa3a71-473e-47c1-9745-5a70b9c08ec2 (68fa3a71-473e-47c1-9745-5a70b9c08ec2): created successfully Sep 17 08:01:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81701b10-2847-4664-8200-c1559be4b51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Flow 'volume_create_manager' (b7ea2071-4ce3-4525-b0ef-ea193f12078a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1d870753-f6aa-4671-8ebb-53f23683fcfc 1073741824" returned: 0 in 0.461s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1d870753-f6aa-4671-8ebb-53f23683fcfc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:42 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-05e781db-c5be-4bcb-8a2c-9dc1731f8e90 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Created volume successfully. Sep 17 08:01:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1d870753-f6aa-4671-8ebb-53f23683fcfc" returned: 0 in 0.315s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] <== create_volume: return (803ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:01:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052f2dae-2dfe-4cb4-ab50-b82b93691d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d870753-f6aa-4671-8ebb-53f23683fcfc', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acdbd74-9101-4d4c-b881-9769c0b66357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:01:42 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume volume-1d870753-f6aa-4671-8ebb-53f23683fcfc (1d870753-f6aa-4671-8ebb-53f23683fcfc): created successfully Sep 17 08:01:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acdbd74-9101-4d4c-b881-9769c0b66357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:01:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Flow 'volume_create_manager' (030ef668-33fd-4331-be6a-db2e078940aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:01:42 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-6c024a96-05d9-498e-9a91-7bca2b952f46 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Created volume successfully. Sep 17 08:01:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "cinder-1d870753-f6aa-4671-8ebb-53f23683fcfc-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-1d870753-f6aa-4671-8ebb-53f23683fcfc-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:44 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "cinder-quobyte-1d870753-f6aa-4671-8ebb-53f23683fcfc" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-quobyte-1d870753-f6aa-4671-8ebb-53f23683fcfc" acquired by "delete_volume" :: waited 0.012s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:44 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[05337798-3f38-42ec-a3e1-f6249458f152]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1d870753-f6aa-4671-8ebb-53f23683fcfc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1d870753-f6aa-4671-8ebb-53f23683fcfc" returned: 0 in 0.429s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1d870753-f6aa-4671-8ebb-53f23683fcfc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-1d870753-f6aa-4671-8ebb-53f23683fcfc" returned: 0 in 0.082s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-quobyte-1d870753-f6aa-4671-8ebb-53f23683fcfc" released by "delete_volume" :: held 0.657s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:45 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Created reservations ['a61dbab4-982c-4905-9d87-e889fc2572d5', '8d336996-4780-4e6e-b96d-c96eb68fc392', '7dac41be-5da6-49db-972f-718db9fb3c54', '0f9116be-2ebf-483a-9151-0a87ad531184'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:01:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.094s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:45 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:01:45 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Deleted volume successfully. Sep 17 08:01:45 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c4d1977b-d3d1-4b54-bf3b-a98d22361f61 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-1d870753-f6aa-4671-8ebb-53f23683fcfc-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "cinder-68fa3a71-473e-47c1-9745-5a70b9c08ec2-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-68fa3a71-473e-47c1-9745-5a70b9c08ec2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:46 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "cinder-quobyte-68fa3a71-473e-47c1-9745-5a70b9c08ec2" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-quobyte-68fa3a71-473e-47c1-9745-5a70b9c08ec2" acquired by "delete_volume" :: waited 0.018s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:46 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c79262-9fdd-416a-a8ff-4851f7d68049]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-68fa3a71-473e-47c1-9745-5a70b9c08ec2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-68fa3a71-473e-47c1-9745-5a70b9c08ec2" returned: 0 in 0.403s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-68fa3a71-473e-47c1-9745-5a70b9c08ec2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-68fa3a71-473e-47c1-9745-5a70b9c08ec2" returned: 0 in 0.090s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-quobyte-68fa3a71-473e-47c1-9745-5a70b9c08ec2" released by "delete_volume" :: held 0.646s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:47 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Created reservations ['d6351093-5642-4b18-b1c8-ea6f47f8f11f', '070c759e-9bcd-41d5-a3a4-0db9bffbe89a', '6de4dfc2-1a9c-48ec-bfd8-b95b84ec30af', 'ea60843b-253f-4330-a205-34a56bb42089'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:01:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.079s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:47 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:01:47 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Deleted volume successfully. Sep 17 08:01:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4e12eac9-9cfe-426b-8580-c8690925316e tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-68fa3a71-473e-47c1-9745-5a70b9c08ec2-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "cinder-979fec26-5248-4f72-ba33-e44975b76d5d-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-979fec26-5248-4f72-ba33-e44975b76d5d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:48 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "cinder-quobyte-979fec26-5248-4f72-ba33-e44975b76d5d" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-quobyte-979fec26-5248-4f72-ba33-e44975b76d5d" acquired by "delete_volume" :: waited 0.015s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:48 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be3e883-865f-46cb-82cd-f76507faa5ba]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-979fec26-5248-4f72-ba33-e44975b76d5d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:49 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-0edbb22a-ec26-4b3d-b1a2-54b0c548b2ec req-28c0280b-49ee-4950-936b-6544e03f9511 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:49 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-0edbb22a-ec26-4b3d-b1a2-54b0c548b2ec req-28c0280b-49ee-4950-936b-6544e03f9511 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:49 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-0edbb22a-ec26-4b3d-b1a2-54b0c548b2ec req-28c0280b-49ee-4950-936b-6544e03f9511 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Terminate volume connection completed successfully. Sep 17 08:01:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-0edbb22a-ec26-4b3d-b1a2-54b0c548b2ec req-28c0280b-49ee-4950-936b-6544e03f9511 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Deleting attachment ff0a17b5-7079-44fa-9566-ac842ecb8c8d. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 08:01:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-979fec26-5248-4f72-ba33-e44975b76d5d" returned: 0 in 0.684s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-979fec26-5248-4f72-ba33-e44975b76d5d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-979fec26-5248-4f72-ba33-e44975b76d5d" returned: 0 in 0.114s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-quobyte-979fec26-5248-4f72-ba33-e44975b76d5d" released by "delete_volume" :: held 0.949s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:50 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=66,cinder:INSERT=17,cinder:UPDATE=109,cinder:DELETE=16 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:01:50 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Created reservations ['2abedf35-e523-4d48-bada-76a37cfc8689', '271b0a85-c8e5-4d9b-b198-f360bb4cb400', '4bde0402-06d6-4c07-802a-7af688008da6', 'a146c4b3-26c4-44a0-bbae-0864dc690084'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:01:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:50 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:50 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.113s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:50 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:01:50 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Deleted volume successfully. Sep 17 08:01:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-ed173b17-b54b-4503-b124-91f5b2da719d tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-979fec26-5248-4f72-ba33-e44975b76d5d-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "cinder-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:51 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "cinder-quobyte-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-quobyte-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1" acquired by "delete_volume" :: waited 0.018s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:51 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d696792-bf31-42b5-91f9-0ba58590dc49]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1" returned: 0 in 0.485s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1" returned: 0 in 0.100s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-quobyte-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1" released by "delete_volume" :: held 0.763s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:52 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Created reservations ['d2aca9b9-7212-4451-9190-65b7f4357529', '2d217d3c-3c63-4c1b-9492-5fc92a75bf00', 'fd6b1eff-be6e-4c77-ba63-71584176be6c', 'fdf2bf36-b2ac-4ed6-a94b-b60d208d4612'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:01:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.054s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.100s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.259s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:53 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:01:53 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Deleted volume successfully. Sep 17 08:01:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "cinder-b1126157-2f41-4f73-9736-630853e867ac-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-b1126157-2f41-4f73-9736-630853e867ac-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-bc6efb89-387d-42c0-8553-6020151ab395 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-aa050dea-cc66-4d5d-b0cd-a0b00d6052f1-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:54 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "cinder-quobyte-b1126157-2f41-4f73-9736-630853e867ac" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-quobyte-b1126157-2f41-4f73-9736-630853e867ac" acquired by "delete_volume" :: waited 0.024s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:54 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ac74aa-03ba-4a32-b303-29e7107e6d53]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b1126157-2f41-4f73-9736-630853e867ac {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b1126157-2f41-4f73-9736-630853e867ac" returned: 0 in 0.513s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b1126157-2f41-4f73-9736-630853e867ac {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b1126157-2f41-4f73-9736-630853e867ac" returned: 0 in 0.175s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-quobyte-b1126157-2f41-4f73-9736-630853e867ac" released by "delete_volume" :: held 1.008s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:55 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Created reservations ['bc11a2ad-e800-4cec-9b6f-144481681c0c', '61607460-61ec-4627-a790-491fc4b4014b', 'e277e997-4d40-4ddb-a73b-3c9e6e793099', '86fafa47-c00e-4e9c-8cc7-b30019cb4f9b'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:01:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "cinder-21190a26-5751-4b27-aa0e-b813f72d6a80-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.835s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:57 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:01:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-21190a26-5751-4b27-aa0e-b813f72d6a80-delete_volume" acquired by "delete_volume" :: waited 0.188s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Deleted volume successfully. Sep 17 08:01:57 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:01:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "cinder-quobyte-21190a26-5751-4b27-aa0e-b813f72d6a80" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:01:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-708af3fb-258e-43ff-98a9-638970977634 tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-b1126157-2f41-4f73-9736-630853e867ac-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-quobyte-21190a26-5751-4b27-aa0e-b813f72d6a80" acquired by "delete_volume" :: waited 0.031s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:01:57 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5334cef7-a1f1-4c86-bc79-6d3c10cb6611]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:01:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-21190a26-5751-4b27-aa0e-b813f72d6a80 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-21190a26-5751-4b27-aa0e-b813f72d6a80" returned: 0 in 0.578s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-21190a26-5751-4b27-aa0e-b813f72d6a80 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-21190a26-5751-4b27-aa0e-b813f72d6a80" returned: 0 in 0.141s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-quobyte-21190a26-5751-4b27-aa0e-b813f72d6a80" released by "delete_volume" :: held 0.961s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:01:58 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Created reservations ['494e8b48-31a6-4740-bcbd-cdee236867e6', 'e0d26ff3-321e-474e-953c-dec1c13def77', '0dcb3de4-3e82-430f-9936-77d25cd3a8e7', '611455fa-c65a-4983-9b0c-40158045bd98'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:01:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:01:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:01:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:01:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:01:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:01:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:01:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.094s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:01:59 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:01:59 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Deleted volume successfully. Sep 17 08:01:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7de3a096-a364-4711-ba71-4a50b4ccb5ec tempest-CreateVolumesFromSourceVolumeTest-1338691674 None] Lock "cinder-21190a26-5751-4b27-aa0e-b813f72d6a80-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:02:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Acquiring lock "cinder-3a39d946-9739-47c0-982c-c0880ce6e050-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:02:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "cinder-3a39d946-9739-47c0-982c-c0880ce6e050-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:02:04 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:02:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Acquiring lock "cinder-quobyte-3a39d946-9739-47c0-982c-c0880ce6e050" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:02:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "cinder-quobyte-3a39d946-9739-47c0-982c-c0880ce6e050" acquired by "delete_volume" :: waited 0.037s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:02:04 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2589e903-2f51-4354-808c-58e1852e9e78]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:02:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3a39d946-9739-47c0-982c-c0880ce6e050 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3a39d946-9739-47c0-982c-c0880ce6e050" returned: 0 in 0.648s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3a39d946-9739-47c0-982c-c0880ce6e050 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-3a39d946-9739-47c0-982c-c0880ce6e050" returned: 0 in 0.154s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:05 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "cinder-quobyte-3a39d946-9739-47c0-982c-c0880ce6e050" released by "delete_volume" :: held 1.065s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:02:05 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Created reservations ['6a023635-fca8-4fa0-adb6-1dd0cb897379', 'f0458e81-3d81-4c96-94db-9845481b4eb2', '505bc6e7-fb5f-48c6-bb1f-5bb3ada35eed', '9c6695fe-3034-4cfe-b39e-7f8fbab2f79b'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:02:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:02:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:02:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:02:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:02:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:02:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.184s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:06 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:02:06 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Deleted volume successfully. Sep 17 08:02:06 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Acquiring lock "cinder-2e9f0739-78a9-465e-8711-84c9e8a53edd-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:02:06 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c8aa4f72-0763-4f95-b424-892c989ba5d6 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "cinder-3a39d946-9739-47c0-982c-c0880ce6e050-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:02:06 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "cinder-2e9f0739-78a9-465e-8711-84c9e8a53edd-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:02:07 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:02:07 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Acquiring lock "cinder-quobyte-2e9f0739-78a9-465e-8711-84c9e8a53edd" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:02:07 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "cinder-quobyte-2e9f0739-78a9-465e-8711-84c9e8a53edd" acquired by "delete_volume" :: waited 0.018s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:02:07 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6857dab1-abc7-4563-8c24-f49c300ab5e7]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:02:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2e9f0739-78a9-465e-8711-84c9e8a53edd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2e9f0739-78a9-465e-8711-84c9e8a53edd" returned: 0 in 0.983s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2e9f0739-78a9-465e-8711-84c9e8a53edd {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:08 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:02:08 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:02:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Flow 'volume_create_manager' (2e53d0cc-f569-477b-afd3-d119172c5ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:02:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11b0d0a-b50e-417a-89ee-a4146b63b761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:02:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2e9f0739-78a9-465e-8711-84c9e8a53edd" returned: 0 in 0.556s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11b0d0a-b50e-417a-89ee-a4146b63b761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e935ac36-60a7-4cbc-98ba-01dd7d93cab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b7fdbaaa4b4ec59c74642a566d4fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:02:08Z,use_quota=True,user_id='b0801a2e230a4c21b328e11da0769fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:02:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f413681-eeaa-4b80-84db-33562ca8dba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:02:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f413681-eeaa-4b80-84db-33562ca8dba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:02:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddd5450-2fbe-4175-a075-c8b4da39f75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:02:08 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "cinder-quobyte-2e9f0739-78a9-465e-8711-84c9e8a53edd" released by "delete_volume" :: held 1.755s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Created reservations ['034175c7-d279-46df-8bea-ffaf0f930b75', 'ebcdf97f-7fd5-43b9-8552-7d8e345f94bd', 'ae25b801-5581-496f-9097-3a6d62a129f6', 'e57fb198-077b-499e-9b82-ed69151328e1'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ddd5450-2fbe-4175-a075-c8b4da39f75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e935ac36-60a7-4cbc-98ba-01dd7d93cab2', 'volume_name': 'volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2', 'volume_size': 1, 'image_id': '33de1a66-8681-4c7a-9998-dc3858971fa2', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '23ec3183c947df7aa9d5d54aa403e6f4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43b7fdbaaa4b4ec59c74642a566d4fcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c4780ccd7e3794490bed2b2d458a25480b1153d7a2d59d209fd8a7e3c2dd13d0c1d380f5292cedda2a57d05394b99dcffe334e769771fbaf88a761ec9ecf5d6', 'id': '33de1a66-8681-4c7a-9998-dc3858971fa2', 'created_at': datetime.datetime(2025, 9, 17, 6, 2, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 6, 2, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33de1a66-8681-4c7a-9998-dc3858971fa2/file', 'properties': {}}, 'image_service': }' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a45ca36-c748-40e2-8c88-38b5ec5ba691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a45ca36-c748-40e2-8c88-38b5ec5ba691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c95bf6-b3e0-4379-9854-8aad111856db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:02:09 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Volume e935ac36-60a7-4cbc-98ba-01dd7d93cab2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2', 'volume_size': 1, 'image_id': '33de1a66-8681-4c7a-9998-dc3858971fa2', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '23ec3183c947df7aa9d5d54aa403e6f4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43b7fdbaaa4b4ec59c74642a566d4fcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c4780ccd7e3794490bed2b2d458a25480b1153d7a2d59d209fd8a7e3c2dd13d0c1d380f5292cedda2a57d05394b99dcffe334e769771fbaf88a761ec9ecf5d6', 'id': '33de1a66-8681-4c7a-9998-dc3858971fa2', 'created_at': datetime.datetime(2025, 9, 17, 6, 2, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 6, 2, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33de1a66-8681-4c7a-9998-dc3858971fa2/file', 'properties': {}}, 'image_service': } Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Cloning e935ac36-60a7-4cbc-98ba-01dd7d93cab2 from image 33de1a66-8681-4c7a-9998-dc3858971fa2 at location (None, None). {{(pid=83207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 17 08:02:09 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Image download 0.00 MB at 0.00 MB/s Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.214s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:02:09 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Deleted volume successfully. Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4a64fe-930f-47d0-bdca-7bb5cc25e93b]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:09 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-f8d6d9ea-3807-41e0-8e17-fcd3cae10396 tempest-TestServerVolumeAttachmentScenario-1611442740 None] Lock "cinder-2e9f0739-78a9-465e-8711-84c9e8a53edd-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:02:10 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD Sep 17 08:02:10 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 08:02:12 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Sep 17 08:02:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD" returned: 0 in 2.636s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:12 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD Sep 17 08:02:13 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 08:02:15 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Sep 17 08:02:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD" returned: 1 in 2.734s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:02:15 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Temporary image 33de1a66-8681-4c7a-9998-dc3858971fa2 is fetched for user b0801a2e230a4c21b328e11da0769fc0. {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 17 08:02:15 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[509edb01-dfeb-4077-94aa-a952d5721472]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:02:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:15 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD Sep 17 08:02:15 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 08:02:17 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Sep 17 08:02:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD" returned: 0 in 2.382s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:18 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD Sep 17 08:02:18 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 08:02:20 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Sep 17 08:02:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD" returned: 1 in 2.531s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:02:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:02:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:02:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e935ac36-60a7-4cbc-98ba-01dd7d93cab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b7fdbaaa4b4ec59c74642a566d4fcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:02:08Z,use_quota=True,user_id='b0801a2e230a4c21b328e11da0769fc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:02:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Creating volume e935ac36-60a7-4cbc-98ba-01dd7d93cab2 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:02:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:02:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:02:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:02:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:02:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:02:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:02:20 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:02:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:20 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=135, name=volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:02:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2 1073741824" returned: 0 in 0.357s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2" returned: 0 in 0.090s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:21 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] <== create_volume: return (542ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:02:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.579s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:02:21 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Attempting download of 33de1a66-8681-4c7a-9998-dc3858971fa2 ((None, None)) to volume e935ac36-60a7-4cbc-98ba-01dd7d93cab2. {{(pid=83207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 17 08:02:22 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5b82f4-b77e-4fcf-ba59-7f1e9bab1c28]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:02:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33de1a66-8681-4c7a-9998-dc3858971fa2_hb4uaiim {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33de1a66-8681-4c7a-9998-dc3858971fa2_hb4uaiim" returned: 0 in 0.518s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33de1a66-8681-4c7a-9998-dc3858971fa2_hb4uaiim {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33de1a66-8681-4c7a-9998-dc3858971fa2_hb4uaiim" returned: 1 in 0.502s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33de1a66-8681-4c7a-9998-dc3858971fa2_hb4uaiim' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:02:23 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2532434-a4f3-48cd-b4d4-b12af6593abf]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:02:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD" returned: 1 in 0.450s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:02:24 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] 33de1a66-8681-4c7a-9998-dc3858971fa2 was raw, converting to raw {{(pid=83207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 17 08:02:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:24 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=135, name=volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:02:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2" returned: 0 in 0.239s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:24 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33de1a66-8681-4c7a-9998-dc3858971fa2_hv44dq5xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2 {{(pid=83207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 08:02:24 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 08:02:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2 1G" returned: 0 in 0.153s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:24 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6865a64-ee24-45fc-ae39-957cf00d8cf0]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:02:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2" returned: 0 in 0.371s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:25 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:INSERT=12,cinder:UPDATE=35,cinder:SELECT=27,cinder:DELETE=3 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:02:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2" returned: 1 in 0.455s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:02:25 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Downloaded image 33de1a66-8681-4c7a-9998-dc3858971fa2 ((None, None)) to volume e935ac36-60a7-4cbc-98ba-01dd7d93cab2 successfully. {{(pid=83207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 17 08:02:25 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Temporary image 33de1a66-8681-4c7a-9998-dc3858971fa2 for user b0801a2e230a4c21b328e11da0769fc0 is deleted. {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 17 08:02:25 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Marking volume e935ac36-60a7-4cbc-98ba-01dd7d93cab2 as bootable. {{(pid=83207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 17 08:02:25 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Copying metadata from image 33de1a66-8681-4c7a-9998-dc3858971fa2 to e935ac36-60a7-4cbc-98ba-01dd7d93cab2. {{(pid=83207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 08:02:25 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Creating volume glance metadata for volume e935ac36-60a7-4cbc-98ba-01dd7d93cab2 backed by image 33de1a66-8681-4c7a-9998-dc3858971fa2 with: {'image_id': '33de1a66-8681-4c7a-9998-dc3858971fa2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '23ec3183c947df7aa9d5d54aa403e6f4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 08:02:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c95bf6-b3e0-4379-9854-8aad111856db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2', 'volume_size': 1, 'image_id': '33de1a66-8681-4c7a-9998-dc3858971fa2', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '23ec3183c947df7aa9d5d54aa403e6f4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43b7fdbaaa4b4ec59c74642a566d4fcb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5c4780ccd7e3794490bed2b2d458a25480b1153d7a2d59d209fd8a7e3c2dd13d0c1d380f5292cedda2a57d05394b99dcffe334e769771fbaf88a761ec9ecf5d6', 'id': '33de1a66-8681-4c7a-9998-dc3858971fa2', 'created_at': datetime.datetime(2025, 9, 17, 6, 2, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 6, 2, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33de1a66-8681-4c7a-9998-dc3858971fa2/file', 'properties': {}}, 'image_service': }' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:02:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67f1e69-fbbf-4c09-9835-abe0084702e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:02:26 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Volume volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2 (e935ac36-60a7-4cbc-98ba-01dd7d93cab2): created successfully Sep 17 08:02:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67f1e69-fbbf-4c09-9835-abe0084702e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:02:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Flow 'volume_create_manager' (2e53d0cc-f569-477b-afd3-d119172c5ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:02:26 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-3111d272-9316-426f-bbb4-bfae255d2d24 tempest-VolumeImageDependencyTests-67343989 None] Created volume successfully. Sep 17 08:02:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Acquiring lock "cinder-e935ac36-60a7-4cbc-98ba-01dd7d93cab2-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:02:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Lock "cinder-e935ac36-60a7-4cbc-98ba-01dd7d93cab2-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:02:27 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:02:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Acquiring lock "cinder-quobyte-e935ac36-60a7-4cbc-98ba-01dd7d93cab2" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:02:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Lock "cinder-quobyte-e935ac36-60a7-4cbc-98ba-01dd7d93cab2" acquired by "delete_volume" :: waited 0.012s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:02:27 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dd5f39-6aa4-449e-8919-a083d165be22]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:02:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2" returned: 0 in 0.431s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2" returned: 1 in 0.538s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.241s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e935ac36-60a7-4cbc-98ba-01dd7d93cab2" returned: 0 in 0.182s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Lock "cinder-quobyte-e935ac36-60a7-4cbc-98ba-01dd7d93cab2" released by "delete_volume" :: held 1.352s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:02:28 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Created reservations ['4649d90b-65e0-4d6c-a2fc-ad1dee0db9b5', '00630cd2-47e0-46df-8abc-62b6066bbfbc', '937fbf02-d8bb-415d-a506-98fbef613d51', '5410ed4e-3c5e-4090-ba82-2275de89d099'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:02:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:02:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:02:29 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:02:29 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:02:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:02:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.099s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:29 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:02:29 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Deleted volume successfully. Sep 17 08:02:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-c1d7402f-b7b4-4745-b5a5-f9c0754d1983 tempest-VolumeImageDependencyTests-67343989 None] Lock "cinder-e935ac36-60a7-4cbc-98ba-01dd7d93cab2-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:02:39 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=104,cinder:SELECT=66,cinder:DELETE=6,cinder:INSERT=21 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:02:39 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=6,cinder:INSERT=9,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:02:56 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:02:56 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:02:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Flow 'volume_create_manager' (2b55ef81-5b39-4070-844e-4fcb3561f8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:02:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9648f014-47dc-4759-9cd2-04e3d03ca82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:02:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9648f014-47dc-4759-9cd2-04e3d03ca82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2038500901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d2d4a5-40b7-4745-b261-69ccdf7c1ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2ba13541a24992b791b4572af663fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:02:56Z,use_quota=True,user_id='6d40db921b85440d82c1f6a8d87a7962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:02:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99ccc72-2dcb-4fc4-9e1f-926030cebfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:02:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99ccc72-2dcb-4fc4-9e1f-926030cebfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:02:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695b8f5b-620b-42ca-bcff-fa2d168ed04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:02:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695b8f5b-620b-42ca-bcff-fa2d168ed04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '70d2d4a5-40b7-4745-b261-69ccdf7c1ec0', 'volume_name': 'volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0', 'volume_size': 1, 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91606166160a47f193bac06562c1b40d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c23af952-419c-402d-9c13-65fae52513d0', 'created_at': datetime.datetime(2025, 9, 17, 5, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23af952-419c-402d-9c13-65fae52513d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:02:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57cd182-6f37-4073-8cad-342336ae57d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:02:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57cd182-6f37-4073-8cad-342336ae57d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:02:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36da7873-36b1-4db0-9bfa-66ee6ff12f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:02:56 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Volume 70d2d4a5-40b7-4745-b261-69ccdf7c1ec0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0', 'volume_size': 1, 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91606166160a47f193bac06562c1b40d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c23af952-419c-402d-9c13-65fae52513d0', 'created_at': datetime.datetime(2025, 9, 17, 5, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23af952-419c-402d-9c13-65fae52513d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 08:02:56 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Cloning 70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 from image c23af952-419c-402d-9c13-65fae52513d0 at location (None, None). {{(pid=83207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}} Sep 17 08:02:57 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_s34dy9medevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 17 08:02:57 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Image download 20.69 MB at 20.69 MB/s Sep 17 08:02:57 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b516dd-93d5-454b-ade0-190b5d422dc9]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:02:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_s34dy9medevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:02:57 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_s34dy9medevstack@QuobyteHD Sep 17 08:02:57 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 08:02:59 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Sep 17 08:02:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_s34dy9medevstack@QuobyteHD" returned: 0 in 1.900s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:02:59 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Temporary image c23af952-419c-402d-9c13-65fae52513d0 is fetched for user 6d40db921b85440d82c1f6a8d87a7962. {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 17 08:02:59 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[918033b2-7922-4598-8c9e-7c1b754ae128]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:02:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_s34dy9medevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:03:00 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_s34dy9medevstack@QuobyteHD Sep 17 08:03:00 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 08:03:01 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 17 08:03:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_s34dy9medevstack@QuobyteHD" returned: 0 in 1.935s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:03:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:03:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:03:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2038500901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d2d4a5-40b7-4745-b261-69ccdf7c1ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2ba13541a24992b791b4572af663fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:02:56Z,use_quota=True,user_id='6d40db921b85440d82c1f6a8d87a7962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:03:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Creating volume 70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:03:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:03:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:03:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:03:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:03:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:03:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:03:01 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:03:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:03:01 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=136, name=volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:03:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 1073741824" returned: 0 in 0.336s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:03:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:03:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0" returned: 0 in 0.086s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:03:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] <== create_volume: return (515ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:03:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.548s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:03:02 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Attempting download of c23af952-419c-402d-9c13-65fae52513d0 ((None, None)) to volume 70d2d4a5-40b7-4745-b261-69ccdf7c1ec0. {{(pid=83207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 17 08:03:02 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[534d5c4e-aa98-4f34-af1a-97ff23571519]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:03:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_is74hv1v {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:03:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_is74hv1v" returned: 0 in 0.383s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:03:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_is74hv1v {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:03:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_is74hv1v" returned: 1 in 0.325s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:03:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c23af952-419c-402d-9c13-65fae52513d0_is74hv1v' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:03:03 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45eff00-f715-49a3-82d0-b9c02b9a4c1f]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:03:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_s34dy9medevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:03:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_s34dy9medevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:03:03 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] c23af952-419c-402d-9c13-65fae52513d0 was qcow2, converting to raw {{(pid=83207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 17 08:03:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_s34dy9medevstack@QuobyteHD /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:03:03 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=136, name=volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:03:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_s34dy9medevstack@QuobyteHD /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0" returned: 0 in 1.062s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:03:04 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c23af952-419c-402d-9c13-65fae52513d0_s34dy9medevstack@QuobyteHD, size 112.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 {{(pid=83207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 08:03:04 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Converted 112.00 MB image at 102.96 MB/s Sep 17 08:03:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:03:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 1G" returned: 0 in 0.136s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:03:05 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[402af8e2-9e1a-4bb8-9366-fc087bb2c233]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:03:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:03:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0" returned: 0 in 0.371s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:03:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:03:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0" returned: 1 in 0.379s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:03:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:03:05 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Downloaded image c23af952-419c-402d-9c13-65fae52513d0 ((None, None)) to volume 70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 successfully. {{(pid=83207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 17 08:03:05 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Temporary image c23af952-419c-402d-9c13-65fae52513d0 for user 6d40db921b85440d82c1f6a8d87a7962 is deleted. {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 17 08:03:05 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Marking volume 70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 as bootable. {{(pid=83207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 17 08:03:06 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Copying metadata from image c23af952-419c-402d-9c13-65fae52513d0 to 70d2d4a5-40b7-4745-b261-69ccdf7c1ec0. {{(pid=83207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 08:03:06 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Creating volume glance metadata for volume 70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 backed by image c23af952-419c-402d-9c13-65fae52513d0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 08:03:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36da7873-36b1-4db0-9bfa-66ee6ff12f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0', 'volume_size': 1, 'image_id': 'c23af952-419c-402d-9c13-65fae52513d0', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91606166160a47f193bac06562c1b40d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c23af952-419c-402d-9c13-65fae52513d0', 'created_at': datetime.datetime(2025, 9, 17, 5, 15, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 5, 15, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c23af952-419c-402d-9c13-65fae52513d0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:03:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db67f16c-e74b-4e45-9b80-3c62ca38b003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:03:06 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Volume volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 (70d2d4a5-40b7-4745-b261-69ccdf7c1ec0): created successfully Sep 17 08:03:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db67f16c-e74b-4e45-9b80-3c62ca38b003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:03:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Flow 'volume_create_manager' (2b55ef81-5b39-4070-844e-4fcb3561f8f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:03:06 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4cadae37-538b-42b5-bdc3-b77d0c87460f tempest-TestShelveInstance-705127552 None] Created volume successfully. Sep 17 08:03:16 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=9,cinder:INSERT=7,cinder:UPDATE=4 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:03:16 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8,cinder:INSERT=6,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:03:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-17ea4913-a246-498c-b385-c01f4dc8486a req-c6569d79-9070-480c-8236-ecc05b1fa2d7 tempest-TestShelveInstance-705127552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:03:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-17ea4913-a246-498c-b385-c01f4dc8486a req-c6569d79-9070-480c-8236-ecc05b1fa2d7 tempest-TestShelveInstance-705127552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:03:17 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfa9d09-bf7c-45e7-998c-bf5b3a237fc8]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:03:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-17ea4913-a246-498c-b385-c01f4dc8486a req-c6569d79-9070-480c-8236-ecc05b1fa2d7 tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:03:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-17ea4913-a246-498c-b385-c01f4dc8486a req-c6569d79-9070-480c-8236-ecc05b1fa2d7 tempest-TestShelveInstance-705127552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0" returned: 0 in 0.461s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:03:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-17ea4913-a246-498c-b385-c01f4dc8486a req-c6569d79-9070-480c-8236-ecc05b1fa2d7 tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:03:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-17ea4913-a246-498c-b385-c01f4dc8486a req-c6569d79-9070-480c-8236-ecc05b1fa2d7 tempest-TestShelveInstance-705127552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0" returned: 1 in 0.420s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:03:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-17ea4913-a246-498c-b385-c01f4dc8486a req-c6569d79-9070-480c-8236-ecc05b1fa2d7 tempest-TestShelveInstance-705127552 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:03:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-17ea4913-a246-498c-b385-c01f4dc8486a req-c6569d79-9070-480c-8236-ecc05b1fa2d7 tempest-TestShelveInstance-705127552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:03:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-17ea4913-a246-498c-b385-c01f4dc8486a req-c6569d79-9070-480c-8236-ecc05b1fa2d7 tempest-TestShelveInstance-705127552 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '130e89a3-1b17-46d9-a71e-30b14106e0f9', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 08:03:18 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-17ea4913-a246-498c-b385-c01f4dc8486a req-c6569d79-9070-480c-8236-ecc05b1fa2d7 tempest-TestShelveInstance-705127552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:03:18 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-17ea4913-a246-498c-b385-c01f4dc8486a req-c6569d79-9070-480c-8236-ecc05b1fa2d7 tempest-TestShelveInstance-705127552 None] attachment_update completed successfully. Sep 17 08:03:28 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 08:03:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:03:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:03:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:03:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:03:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:03:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:03:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.135s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:03:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:03:28 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:03:28 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:04:06 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:04:06 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:04:28 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 08:04:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:04:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:04:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:04:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:04:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:04:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:04:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.102s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:04:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:04:49 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-a29a3d85-952b-4da6-bcc2-232746e52f75 req-4cececb8-8290-4bb3-90e0-76efa8404705 tempest-TestShelveInstance-705127552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:04:49 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-a29a3d85-952b-4da6-bcc2-232746e52f75 req-4cececb8-8290-4bb3-90e0-76efa8404705 tempest-TestShelveInstance-705127552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:04:49 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-a29a3d85-952b-4da6-bcc2-232746e52f75 req-4cececb8-8290-4bb3-90e0-76efa8404705 tempest-TestShelveInstance-705127552 None] Terminate volume connection completed successfully. Sep 17 08:04:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-a29a3d85-952b-4da6-bcc2-232746e52f75 req-4cececb8-8290-4bb3-90e0-76efa8404705 tempest-TestShelveInstance-705127552 None] Deleting attachment 130e89a3-1b17-46d9-a71e-30b14106e0f9. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 08:04:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-286e985c-edfa-40d3-b8bc-5569fb052c57 req-c4b817ea-e555-4ec3-92b1-716462089d25 tempest-TestShelveInstance-705127552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:04:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-286e985c-edfa-40d3-b8bc-5569fb052c57 req-c4b817ea-e555-4ec3-92b1-716462089d25 tempest-TestShelveInstance-705127552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:04:55 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ecb65d-b0d1-4a29-83bb-3bf831bb36b4]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:04:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-286e985c-edfa-40d3-b8bc-5569fb052c57 req-c4b817ea-e555-4ec3-92b1-716462089d25 tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:04:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-286e985c-edfa-40d3-b8bc-5569fb052c57 req-c4b817ea-e555-4ec3-92b1-716462089d25 tempest-TestShelveInstance-705127552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0" returned: 0 in 0.369s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:04:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-286e985c-edfa-40d3-b8bc-5569fb052c57 req-c4b817ea-e555-4ec3-92b1-716462089d25 tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:04:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-286e985c-edfa-40d3-b8bc-5569fb052c57 req-c4b817ea-e555-4ec3-92b1-716462089d25 tempest-TestShelveInstance-705127552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0" returned: 1 in 0.360s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:04:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-286e985c-edfa-40d3-b8bc-5569fb052c57 req-c4b817ea-e555-4ec3-92b1-716462089d25 tempest-TestShelveInstance-705127552 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:04:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-286e985c-edfa-40d3-b8bc-5569fb052c57 req-c4b817ea-e555-4ec3-92b1-716462089d25 tempest-TestShelveInstance-705127552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.916s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:04:56 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-286e985c-edfa-40d3-b8bc-5569fb052c57 req-c4b817ea-e555-4ec3-92b1-716462089d25 tempest-TestShelveInstance-705127552 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe', 'name': 'volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e96b5371-5c80-445b-8b81-6b98c70cce99', 'enforce_multipath': True} {{(pid=83207) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 17 08:04:56 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-286e985c-edfa-40d3-b8bc-5569fb052c57 req-c4b817ea-e555-4ec3-92b1-716462089d25 tempest-TestShelveInstance-705127552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:04:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-286e985c-edfa-40d3-b8bc-5569fb052c57 req-c4b817ea-e555-4ec3-92b1-716462089d25 tempest-TestShelveInstance-705127552 None] attachment_update completed successfully. Sep 17 08:05:07 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:05:07 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:05:28 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 08:05:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:05:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:05:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:05:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:05:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:05:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:05:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.085s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:05:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:06:06 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:06:26 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-df8d9739-7f8c-49c2-9ec2-dce422176678 tempest-TestShelveInstance-705127552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:06:26 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-df8d9739-7f8c-49c2-9ec2-dce422176678 tempest-TestShelveInstance-705127552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:06:26 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-df8d9739-7f8c-49c2-9ec2-dce422176678 tempest-TestShelveInstance-705127552 None] Terminate volume connection completed successfully. Sep 17 08:06:26 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-df8d9739-7f8c-49c2-9ec2-dce422176678 tempest-TestShelveInstance-705127552 None] Deleting attachment e96b5371-5c80-445b-8b81-6b98c70cce99. {{(pid=83207) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 17 08:06:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Acquiring lock "cinder-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:06:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Lock "cinder-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:06:27 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:06:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Acquiring lock "cinder-quobyte-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:06:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Lock "cinder-quobyte-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0" acquired by "delete_volume" :: waited 0.014s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:06:27 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9491ed3-1d75-4ce0-a56a-fa989d89b5d8]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:06:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.111s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0" returned: 0 in 0.456s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0" returned: 1 in 0.373s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0" returned: 0 in 0.109s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Lock "cinder-quobyte-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0" released by "delete_volume" :: held 1.192s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:06:29 devstack cinder-volume[83207]: DEBUG cinder.quota [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Created reservations ['bf7800ca-4be0-4b6c-8dfc-d3eb7e73c9ae', '427fe063-dcbe-4afe-9f40-e3184ff3490e', '3359a634-0b86-4352-ace5-5659000fb7b1', '302473bb-7e52-44d3-b28a-ae20ce1b7f16'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:06:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:29 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:06:29 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:06:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.091s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:29 devstack cinder-volume[83207]: DEBUG cinder.manager [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:06:29 devstack cinder-volume[83207]: INFO cinder.volume.manager [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Deleted volume successfully. Sep 17 08:06:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [req-51f3221f-7d05-45fa-b5f0-61991099b0b8 req-6b8fb696-d6d7-487e-a1d7-d6a83259cf88 tempest-TestShelveInstance-705127552 None] Lock "cinder-70d2d4a5-40b7-4745-b261-69ccdf7c1ec0-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:06:39 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:06:39 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:06:45 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Flow 'volume_create_manager' (9f53dc36-8c8a-46a8-8818-b82aedd7f336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e246f132-6b2e-4b27-a137-254628d07909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e246f132-6b2e-4b27-a137-254628d07909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1785241306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808cc467-480d-452c-8435-a68acc019804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78514623fe34e8ca2f1efbfaea20a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:06:45Z,use_quota=True,user_id='7877e7e49cb2446b8259f1da3ad6f4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25279ffd-45f0-443c-9e22-f0d0e14a612e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25279ffd-45f0-443c-9e22-f0d0e14a612e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7ff16d-6f88-43ac-987f-bf155e67db6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7ff16d-6f88-43ac-987f-bf155e67db6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '808cc467-480d-452c-8435-a68acc019804', 'volume_name': 'volume-808cc467-480d-452c-8435-a68acc019804', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcaad89-e493-4bc2-a288-2229db97f8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcaad89-e493-4bc2-a288-2229db97f8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47af86e8-96b5-4f28-8b3d-e3d812521089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:45 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Volume 808cc467-480d-452c-8435-a68acc019804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-808cc467-480d-452c-8435-a68acc019804', 'volume_size': 1} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1785241306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=808cc467-480d-452c-8435-a68acc019804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78514623fe34e8ca2f1efbfaea20a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:06:45Z,use_quota=True,user_id='7877e7e49cb2446b8259f1da3ad6f4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Creating volume 808cc467-480d-452c-8435-a68acc019804 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:06:45 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:06:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-808cc467-480d-452c-8435-a68acc019804 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:45 devstack quobyte-client[83219]: System call of process 101820 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:06:45 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=137, name=volume-808cc467-480d-452c-8435-a68acc019804, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-808cc467-480d-452c-8435-a68acc019804 1073741824" returned: 0 in 0.489s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-808cc467-480d-452c-8435-a68acc019804 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-808cc467-480d-452c-8435-a68acc019804" returned: 0 in 0.179s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] <== create_volume: return (728ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:46 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Flow 'volume_create_manager' (722d1349-e375-4eee-bd95-859e2d7c5fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459fd561-bfbe-41a2-a368-450ee2165dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459fd561-bfbe-41a2-a368-450ee2165dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1709606598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82937e73-1ee2-476b-9035-df817f8c25f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78514623fe34e8ca2f1efbfaea20a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:06:46Z,use_quota=True,user_id='7877e7e49cb2446b8259f1da3ad6f4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8f434c-8686-4429-bff3-a0a4ac409355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8f434c-8686-4429-bff3-a0a4ac409355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a0044c-f984-4a60-9c2c-adc8484610f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a0044c-f984-4a60-9c2c-adc8484610f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82937e73-1ee2-476b-9035-df817f8c25f8', 'volume_name': 'volume-82937e73-1ee2-476b-9035-df817f8c25f8', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d041d16d-dbf1-41a4-8e18-695e8de666a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d041d16d-dbf1-41a4-8e18-695e8de666a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a31670-04cb-40b8-8d39-7dbbbced210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:46 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Volume 82937e73-1ee2-476b-9035-df817f8c25f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82937e73-1ee2-476b-9035-df817f8c25f8', 'volume_size': 1} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1709606598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82937e73-1ee2-476b-9035-df817f8c25f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78514623fe34e8ca2f1efbfaea20a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:06:46Z,use_quota=True,user_id='7877e7e49cb2446b8259f1da3ad6f4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Creating volume 82937e73-1ee2-476b-9035-df817f8c25f8 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:06:46 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-82937e73-1ee2-476b-9035-df817f8c25f8 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:46 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=138, name=volume-82937e73-1ee2-476b-9035-df817f8c25f8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47af86e8-96b5-4f28-8b3d-e3d812521089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-808cc467-480d-452c-8435-a68acc019804', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf739f13-e0f4-41b1-95ab-15a8ec5c93a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-82937e73-1ee2-476b-9035-df817f8c25f8 1073741824" returned: 0 in 0.443s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-82937e73-1ee2-476b-9035-df817f8c25f8 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-82937e73-1ee2-476b-9035-df817f8c25f8" returned: 0 in 0.096s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] <== create_volume: return (582ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.595s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:47 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Volume volume-808cc467-480d-452c-8435-a68acc019804 (808cc467-480d-452c-8435-a68acc019804): created successfully Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf739f13-e0f4-41b1-95ab-15a8ec5c93a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Flow 'volume_create_manager' (9f53dc36-8c8a-46a8-8818-b82aedd7f336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a31670-04cb-40b8-8d39-7dbbbced210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82937e73-1ee2-476b-9035-df817f8c25f8', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98784857-d8cd-4e01-8b80-0aca6d34bf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:47 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Flow 'volume_create_manager' (8490d49c-a2af-4daa-8268-24fc1f4adb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d6cc58b-d9ef-4884-8e98-96572df7a187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:47 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-18a77418-9a13-4007-80c4-c3900541d516 tempest-CreateVolumesFromImageTest-1559478605 None] Created volume successfully. Sep 17 08:06:47 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Volume volume-82937e73-1ee2-476b-9035-df817f8c25f8 (82937e73-1ee2-476b-9035-df817f8c25f8): created successfully Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98784857-d8cd-4e01-8b80-0aca6d34bf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Flow 'volume_create_manager' (722d1349-e375-4eee-bd95-859e2d7c5fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d6cc58b-d9ef-4884-8e98-96572df7a187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-920195373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcf63ba-1785-47b1-b19b-9d51a5526ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78514623fe34e8ca2f1efbfaea20a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:06:47Z,use_quota=True,user_id='7877e7e49cb2446b8259f1da3ad6f4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad8bd26-a8d7-4c4c-8db4-45c8889c559b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad8bd26-a8d7-4c4c-8db4-45c8889c559b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68622280-d027-49f3-b41c-06524d80dbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68622280-d027-49f3-b41c-06524d80dbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fcf63ba-1785-47b1-b19b-9d51a5526ba5', 'volume_name': 'volume-6fcf63ba-1785-47b1-b19b-9d51a5526ba5', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee2b336-cbd0-4304-ad46-21bfa2773bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee2b336-cbd0-4304-ad46-21bfa2773bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db93800-aa03-4de7-a778-c2efa64c6ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:47 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Volume 6fcf63ba-1785-47b1-b19b-9d51a5526ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fcf63ba-1785-47b1-b19b-9d51a5526ba5', 'volume_size': 1} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-920195373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcf63ba-1785-47b1-b19b-9d51a5526ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78514623fe34e8ca2f1efbfaea20a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:06:47Z,use_quota=True,user_id='7877e7e49cb2446b8259f1da3ad6f4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Creating volume 6fcf63ba-1785-47b1-b19b-9d51a5526ba5 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:06:47 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:06:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6fcf63ba-1785-47b1-b19b-9d51a5526ba5 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:48 devstack quobyte-client[83219]: System call of process 101828 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:06:48 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=139, name=volume-6fcf63ba-1785-47b1-b19b-9d51a5526ba5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:06:48 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-26934467-a32f-4433-ad0f-38937e23791f tempest-CreateVolumesFromImageTest-1559478605 None] Created volume successfully. Sep 17 08:06:48 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Flow 'volume_create_manager' (797468a1-95a7-4292-bf65-79b90f155bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9e3003-c0de-413d-a3e1-e08368c37373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6fcf63ba-1785-47b1-b19b-9d51a5526ba5 1073741824" returned: 0 in 0.624s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6fcf63ba-1785-47b1-b19b-9d51a5526ba5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9e3003-c0de-413d-a3e1-e08368c37373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2076814395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e18331ee-f206-4714-9524-d57c5e720ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78514623fe34e8ca2f1efbfaea20a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:06:48Z,use_quota=True,user_id='7877e7e49cb2446b8259f1da3ad6f4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dce5465-f1d2-49ba-aa57-07b64f50d23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dce5465-f1d2-49ba-aa57-07b64f50d23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd5961e-ca41-4f07-8895-9b40502145b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd5961e-ca41-4f07-8895-9b40502145b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e18331ee-f206-4714-9524-d57c5e720ee0', 'volume_name': 'volume-e18331ee-f206-4714-9524-d57c5e720ee0', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44fb5ea6-fcc5-43d7-ac60-afef873ab9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44fb5ea6-fcc5-43d7-ac60-afef873ab9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b70325-bf17-465d-92d7-41cdaa85e107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:48 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Volume e18331ee-f206-4714-9524-d57c5e720ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e18331ee-f206-4714-9524-d57c5e720ee0', 'volume_size': 1} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6fcf63ba-1785-47b1-b19b-9d51a5526ba5" returned: 0 in 0.433s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] <== create_volume: return (1089ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.039s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2076814395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e18331ee-f206-4714-9524-d57c5e720ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78514623fe34e8ca2f1efbfaea20a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:06:48Z,use_quota=True,user_id='7877e7e49cb2446b8259f1da3ad6f4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Creating volume e18331ee-f206-4714-9524-d57c5e720ee0 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:06:48 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:06:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e18331ee-f206-4714-9524-d57c5e720ee0 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:49 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=140, name=volume-e18331ee-f206-4714-9524-d57c5e720ee0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db93800-aa03-4de7-a778-c2efa64c6ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fcf63ba-1785-47b1-b19b-9d51a5526ba5', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3cc348-2228-4a80-9e6c-979ff8f4d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:49 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Flow 'volume_create_manager' (6beb7f3b-89cb-4f24-8ab1-b8b929f69a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371691f3-5793-4843-b9a2-d09558e78be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e18331ee-f206-4714-9524-d57c5e720ee0 1073741824" returned: 0 in 0.544s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e18331ee-f206-4714-9524-d57c5e720ee0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (371691f3-5793-4843-b9a2-d09558e78be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-280774138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1510c5-9aec-4f7c-931f-ce48ecf8aea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78514623fe34e8ca2f1efbfaea20a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:06:49Z,use_quota=True,user_id='7877e7e49cb2446b8259f1da3ad6f4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a396c9-72e6-45cb-94a1-8d40a4b2574d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a396c9-72e6-45cb-94a1-8d40a4b2574d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ee11c1-4cdb-4ae5-ab9e-2adc6af911d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ee11c1-4cdb-4ae5-ab9e-2adc6af911d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1510c5-9aec-4f7c-931f-ce48ecf8aea7', 'volume_name': 'volume-be1510c5-9aec-4f7c-931f-ce48ecf8aea7', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5deae353-6790-4ee2-bbd0-8f1e2187ffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5deae353-6790-4ee2-bbd0-8f1e2187ffc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d1eac7-036e-42f4-88d9-4f1e78ebb880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:49 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Volume be1510c5-9aec-4f7c-931f-ce48ecf8aea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1510c5-9aec-4f7c-931f-ce48ecf8aea7', 'volume_size': 1} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:49 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Volume volume-6fcf63ba-1785-47b1-b19b-9d51a5526ba5 (6fcf63ba-1785-47b1-b19b-9d51a5526ba5): created successfully Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3cc348-2228-4a80-9e6c-979ff8f4d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Flow 'volume_create_manager' (8490d49c-a2af-4daa-8268-24fc1f4adb5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e18331ee-f206-4714-9524-d57c5e720ee0" returned: 0 in 0.370s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] <== create_volume: return (933ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.140s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-280774138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1510c5-9aec-4f7c-931f-ce48ecf8aea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78514623fe34e8ca2f1efbfaea20a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:06:49Z,use_quota=True,user_id='7877e7e49cb2446b8259f1da3ad6f4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Creating volume be1510c5-9aec-4f7c-931f-ce48ecf8aea7 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:06:49 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:06:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-be1510c5-9aec-4f7c-931f-ce48ecf8aea7 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:50 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=141, name=volume-be1510c5-9aec-4f7c-931f-ce48ecf8aea7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:06:50 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-78248870-0fbe-4164-9e7e-9ad038d64509 tempest-CreateVolumesFromImageTest-1559478605 None] Created volume successfully. Sep 17 08:06:50 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b70325-bf17-465d-92d7-41cdaa85e107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e18331ee-f206-4714-9524-d57c5e720ee0', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:50 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da68781b-cddc-4cf0-b6b1-5c5abb217ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:50 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Volume volume-e18331ee-f206-4714-9524-d57c5e720ee0 (e18331ee-f206-4714-9524-d57c5e720ee0): created successfully Sep 17 08:06:50 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da68781b-cddc-4cf0-b6b1-5c5abb217ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:50 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Flow 'volume_create_manager' (797468a1-95a7-4292-bf65-79b90f155bd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:06:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-be1510c5-9aec-4f7c-931f-ce48ecf8aea7 1073741824" returned: 0 in 0.430s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-be1510c5-9aec-4f7c-931f-ce48ecf8aea7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-be1510c5-9aec-4f7c-931f-ce48ecf8aea7" returned: 0 in 0.121s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:50 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] <== create_volume: return (593ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:06:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.607s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:50 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-7492752d-8425-47d5-a4c4-d303473ea79b tempest-CreateVolumesFromImageTest-1559478605 None] Created volume successfully. Sep 17 08:06:50 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d1eac7-036e-42f4-88d9-4f1e78ebb880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1510c5-9aec-4f7c-931f-ce48ecf8aea7', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:50 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2040cc5e-548d-4be4-a687-e4722f6a6f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:06:50 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Volume volume-be1510c5-9aec-4f7c-931f-ce48ecf8aea7 (be1510c5-9aec-4f7c-931f-ce48ecf8aea7): created successfully Sep 17 08:06:50 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2040cc5e-548d-4be4-a687-e4722f6a6f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:06:50 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Flow 'volume_create_manager' (6beb7f3b-89cb-4f24-8ab1-b8b929f69a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:06:50 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-228dbaac-1149-44f2-a905-e3ed355afed2 tempest-CreateVolumesFromImageTest-1559478605 None] Created volume successfully. Sep 17 08:06:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "cinder-be1510c5-9aec-4f7c-931f-ce48ecf8aea7-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:06:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-be1510c5-9aec-4f7c-931f-ce48ecf8aea7-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:06:51 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:06:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "cinder-quobyte-be1510c5-9aec-4f7c-931f-ce48ecf8aea7" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:06:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-quobyte-be1510c5-9aec-4f7c-931f-ce48ecf8aea7" acquired by "delete_volume" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:06:51 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9fc9f5-9d29-4e71-82f4-6a9e88ab6e1d]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:06:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-be1510c5-9aec-4f7c-931f-ce48ecf8aea7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-be1510c5-9aec-4f7c-931f-ce48ecf8aea7" returned: 0 in 0.423s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-be1510c5-9aec-4f7c-931f-ce48ecf8aea7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-be1510c5-9aec-4f7c-931f-ce48ecf8aea7" returned: 0 in 0.083s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-quobyte-be1510c5-9aec-4f7c-931f-ce48ecf8aea7" released by "delete_volume" :: held 0.660s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:06:52 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Created reservations ['a631a4cb-4a10-4dc7-bf58-c47a993ce3e5', '72edc9be-faad-4867-99bf-e91a34dcc7cb', '6755b199-f895-4f6b-891e-c344e7bb652b', '36e40e42-44da-4596-8e1e-6e019df1b466'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:06:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:06:52 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:06:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.090s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:52 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:06:52 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Deleted volume successfully. Sep 17 08:06:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-3404b0eb-c06c-4574-ae8c-47f4c2167a3e tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-be1510c5-9aec-4f7c-931f-ce48ecf8aea7-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:06:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "cinder-e18331ee-f206-4714-9524-d57c5e720ee0-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:06:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-e18331ee-f206-4714-9524-d57c5e720ee0-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:06:53 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:06:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "cinder-quobyte-e18331ee-f206-4714-9524-d57c5e720ee0" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:06:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-quobyte-e18331ee-f206-4714-9524-d57c5e720ee0" acquired by "delete_volume" :: waited 0.016s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:06:53 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ca67bd-fcf9-40e8-b33f-22c171b31d58]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:06:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e18331ee-f206-4714-9524-d57c5e720ee0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e18331ee-f206-4714-9524-d57c5e720ee0" returned: 0 in 0.397s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e18331ee-f206-4714-9524-d57c5e720ee0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e18331ee-f206-4714-9524-d57c5e720ee0" returned: 0 in 0.107s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-quobyte-e18331ee-f206-4714-9524-d57c5e720ee0" released by "delete_volume" :: held 0.637s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:06:54 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Created reservations ['c1bd5833-02c8-4c48-a8f3-a310e0bbc96c', 'f2c9125d-7615-4b04-aa82-fca00dd502d3', '5bace398-36a4-4dde-8622-38e47b52a4d3', '662c498f-fbba-4aaf-b870-e919c2eb025c'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:06:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:06:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:06:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.112s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:54 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:06:54 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Deleted volume successfully. Sep 17 08:06:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9b0eaff2-f91e-4442-b18c-9de862ecd9a5 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-e18331ee-f206-4714-9524-d57c5e720ee0-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:06:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "cinder-6fcf63ba-1785-47b1-b19b-9d51a5526ba5-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:06:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-6fcf63ba-1785-47b1-b19b-9d51a5526ba5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:06:55 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:06:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "cinder-quobyte-6fcf63ba-1785-47b1-b19b-9d51a5526ba5" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:06:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-quobyte-6fcf63ba-1785-47b1-b19b-9d51a5526ba5" acquired by "delete_volume" :: waited 0.015s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:06:55 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[da66fdd3-abf7-4189-8b42-f13364b2c233]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:06:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6fcf63ba-1785-47b1-b19b-9d51a5526ba5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6fcf63ba-1785-47b1-b19b-9d51a5526ba5" returned: 0 in 0.411s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6fcf63ba-1785-47b1-b19b-9d51a5526ba5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6fcf63ba-1785-47b1-b19b-9d51a5526ba5" returned: 0 in 0.083s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-quobyte-6fcf63ba-1785-47b1-b19b-9d51a5526ba5" released by "delete_volume" :: held 0.650s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:06:56 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Created reservations ['4922033d-c3be-4243-b833-d3038769b893', 'add3f9af-a59a-442c-b0b3-e5cc23f176a6', 'c1c9f5a6-741b-430d-9ac1-c0c8d7d4bbc6', 'e8d6ed10-7815-4147-9e61-3ca7e55e3216'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:06:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:06:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:06:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.093s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:57 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:06:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Deleted volume successfully. Sep 17 08:06:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a3cccd18-642a-453a-b29b-add8976d733f tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-6fcf63ba-1785-47b1-b19b-9d51a5526ba5-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:06:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "cinder-82937e73-1ee2-476b-9035-df817f8c25f8-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:06:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-82937e73-1ee2-476b-9035-df817f8c25f8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:06:58 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:06:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "cinder-quobyte-82937e73-1ee2-476b-9035-df817f8c25f8" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:06:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-quobyte-82937e73-1ee2-476b-9035-df817f8c25f8" acquired by "delete_volume" :: waited 0.021s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:06:58 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f1d22a-c5bf-4140-b7b7-b9e30712bab5]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:06:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-82937e73-1ee2-476b-9035-df817f8c25f8 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-82937e73-1ee2-476b-9035-df817f8c25f8" returned: 0 in 0.397s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-82937e73-1ee2-476b-9035-df817f8c25f8 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-82937e73-1ee2-476b-9035-df817f8c25f8" returned: 0 in 0.090s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-quobyte-82937e73-1ee2-476b-9035-df817f8c25f8" released by "delete_volume" :: held 0.640s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:06:59 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Created reservations ['0e222282-bbbe-4277-84ef-d63319471fe6', '91ea0f40-38ad-4438-8eef-5a560f1ef936', 'fce93824-0ccd-4cd0-9d2f-1a300c7307d5', 'cef1bc24-89ba-4b9c-826f-4765e2c54088'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:06:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:06:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:06:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:06:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:06:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:06:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:06:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.096s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:06:59 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:06:59 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Deleted volume successfully. Sep 17 08:06:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7d11f6ad-8f2f-4647-a505-55524d420668 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-82937e73-1ee2-476b-9035-df817f8c25f8-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "cinder-808cc467-480d-452c-8435-a68acc019804-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-808cc467-480d-452c-8435-a68acc019804-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:00 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "cinder-quobyte-808cc467-480d-452c-8435-a68acc019804" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-quobyte-808cc467-480d-452c-8435-a68acc019804" acquired by "delete_volume" :: waited 0.021s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:00 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4767afe-3852-47dd-9920-3c410f7de1c5]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:07:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-808cc467-480d-452c-8435-a68acc019804 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-808cc467-480d-452c-8435-a68acc019804" returned: 0 in 0.398s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-808cc467-480d-452c-8435-a68acc019804 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-808cc467-480d-452c-8435-a68acc019804" returned: 0 in 0.087s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-quobyte-808cc467-480d-452c-8435-a68acc019804" released by "delete_volume" :: held 0.652s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:01 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Created reservations ['adffc931-7fa4-4cf7-9e85-ce72fb486ab4', '42148148-4f07-4fa9-9e1b-5326f3ea0f7a', '5be5b316-8624-4eea-b2e5-790e9a1a571c', 'dda9e174-778a-48b1-a6e9-3279a9739db1'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:07:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:07:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:07:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.085s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:01 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:07:01 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Deleted volume successfully. Sep 17 08:07:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d89c5163-0576-4b43-a8bf-2feed19674d8 tempest-CreateVolumesFromImageTest-1559478605 None] Lock "cinder-808cc467-480d-452c-8435-a68acc019804-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:05 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Flow 'volume_create_manager' (f19c5a22-26be-4c41-a48e-4ee613a1345f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ec1182-7a87-42c8-aec8-82c0c628dae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ec1182-7a87-42c8-aec8-82c0c628dae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d37772e-400e-4307-b8a8-de4cdef69fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeeb5ac3a0a54ede864621d9b2f2199d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:06Z,use_quota=True,user_id='4d69c8fba3454306bde4aadc67795b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ced326e-e574-4022-a181-8e401277099a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ced326e-e574-4022-a181-8e401277099a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62622b27-4315-4a84-81d3-41320b6cc67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62622b27-4315-4a84-81d3-41320b6cc67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d37772e-400e-4307-b8a8-de4cdef69fd0', 'volume_name': 'volume-2d37772e-400e-4307-b8a8-de4cdef69fd0', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e060258-7cf4-4a38-bc51-7260ffb5744b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e060258-7cf4-4a38-bc51-7260ffb5744b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1cfe104-b0d1-4127-90ce-574f4806c01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:05 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Volume 2d37772e-400e-4307-b8a8-de4cdef69fd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d37772e-400e-4307-b8a8-de4cdef69fd0', 'volume_size': 1} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d37772e-400e-4307-b8a8-de4cdef69fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeeb5ac3a0a54ede864621d9b2f2199d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:06Z,use_quota=True,user_id='4d69c8fba3454306bde4aadc67795b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Creating volume 2d37772e-400e-4307-b8a8-de4cdef69fd0 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:07:05 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:07:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2d37772e-400e-4307-b8a8-de4cdef69fd0 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:06 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=142, name=volume-2d37772e-400e-4307-b8a8-de4cdef69fd0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:07:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2d37772e-400e-4307-b8a8-de4cdef69fd0 1073741824" returned: 0 in 0.321s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2d37772e-400e-4307-b8a8-de4cdef69fd0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2d37772e-400e-4307-b8a8-de4cdef69fd0" returned: 0 in 0.082s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:06 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] <== create_volume: return (469ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:07:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.483s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1cfe104-b0d1-4127-90ce-574f4806c01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d37772e-400e-4307-b8a8-de4cdef69fd0', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc4a015-599c-424b-98bb-24f7c44490c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:06 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Volume volume-2d37772e-400e-4307-b8a8-de4cdef69fd0 (2d37772e-400e-4307-b8a8-de4cdef69fd0): created successfully Sep 17 08:07:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc4a015-599c-424b-98bb-24f7c44490c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:06 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Flow 'volume_create_manager' (f19c5a22-26be-4c41-a48e-4ee613a1345f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:06 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-906b7155-0c15-4c90-b0f1-11712874a6f3 tempest-CinderUnicodeTest-1002048456 None] Created volume successfully. Sep 17 08:07:08 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Flow 'volume_create_manager' (d9b9fa9b-1a9d-4179-9471-5a5b5c1ee202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96406424-93c5-4ba0-a003-4a641b7e3543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96406424-93c5-4ba0-a003-4a641b7e3543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-675760549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f238b1-cf93-4598-aa91-1607916364f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeeb5ac3a0a54ede864621d9b2f2199d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:08Z,use_quota=True,user_id='4d69c8fba3454306bde4aadc67795b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e436067e-315a-4e8b-a638-c83d5cc02855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e436067e-315a-4e8b-a638-c83d5cc02855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a86f1b0-71ff-4997-b3ee-c45d60cf78b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a86f1b0-71ff-4997-b3ee-c45d60cf78b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f238b1-cf93-4598-aa91-1607916364f7', 'volume_name': 'volume-61f238b1-cf93-4598-aa91-1607916364f7', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b454f07c-0cb3-448e-b21c-cb4373c8c711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b454f07c-0cb3-448e-b21c-cb4373c8c711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17b1c10-617c-4998-8c33-16a82c5a7a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:08 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Volume 61f238b1-cf93-4598-aa91-1607916364f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f238b1-cf93-4598-aa91-1607916364f7', 'volume_size': 1} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-675760549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f238b1-cf93-4598-aa91-1607916364f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeeb5ac3a0a54ede864621d9b2f2199d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:08Z,use_quota=True,user_id='4d69c8fba3454306bde4aadc67795b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Creating volume 61f238b1-cf93-4598-aa91-1607916364f7 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:07:08 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:08 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=143, name=volume-61f238b1-cf93-4598-aa91-1607916364f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7 1073741824" returned: 0 in 0.327s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7" returned: 0 in 0.086s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] <== create_volume: return (479ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:07:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.492s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17b1c10-617c-4998-8c33-16a82c5a7a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f238b1-cf93-4598-aa91-1607916364f7', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9372113e-e22a-4fcb-85f1-77ff04e1bb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:09 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Volume volume-61f238b1-cf93-4598-aa91-1607916364f7 (61f238b1-cf93-4598-aa91-1607916364f7): created successfully Sep 17 08:07:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9372113e-e22a-4fcb-85f1-77ff04e1bb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Flow 'volume_create_manager' (d9b9fa9b-1a9d-4179-9471-5a5b5c1ee202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:09 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e505bfd0-8d33-41ee-9215-97ed12fdef9d tempest-CinderUnicodeTest-1002048456 None] Created volume successfully. Sep 17 08:07:09 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] Creating offline snapshot a391d429-7a9e-4fac-bb64-3c800712ac0a of volume 61f238b1-cf93-4598-aa91-1607916364f7 {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 08:07:09 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f718552d-00a0-4f06-bac2-e41ea55d0f0b]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:07:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7" returned: 0 in 0.429s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:10 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=144, name=volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:07:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a 1G" returned: 0 in 0.229s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): qemu-img rebase -u -b volume-61f238b1-cf93-4598-aa91-1607916364f7 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:10 devstack quobyte-client[83219]: System call of process 101883 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:07:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] CMD "qemu-img rebase -u -b volume-61f238b1-cf93-4598-aa91-1607916364f7 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a" returned: 0 in 0.150s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 08:07:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a" returned: 0 in 0.077s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:10 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7 -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 08:07:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a" returned: 0 in 0.105s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.info" returned: 0 in 0.089s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:11 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 08:07:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.info" returned: 0 in 0.083s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.471s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:11 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b7aaf411-950e-4614-9140-0dbca016dbad tempest-CinderUnicodeTest-1002048456 None] Create snapshot completed successfully Sep 17 08:07:11 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Acquiring lock "cinder-a391d429-7a9e-4fac-bb64-3c800712ac0a-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:12 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Lock "cinder-a391d429-7a9e-4fac-bb64-3c800712ac0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:12 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:12 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Acquiring lock "cinder-quobyte-61f238b1-cf93-4598-aa91-1607916364f7" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:12 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Lock "cinder-quobyte-61f238b1-cf93-4598-aa91-1607916364f7" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:12 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Acquiring lock "cinder-quobyte-a391d429-7a9e-4fac-bb64-3c800712ac0a" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:12 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Lock "cinder-quobyte-a391d429-7a9e-4fac-bb64-3c800712ac0a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Deleting offline snapshot a391d429-7a9e-4fac-bb64-3c800712ac0a of volume 61f238b1-cf93-4598-aa91-1607916364f7 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 08:07:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] snapshot_file for this snap is: volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 08:07:12 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7977846-cd20-42cd-ba4c-d2a2e00a844e]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:07:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a" returned: 0 in 0.426s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:12 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61f238b1-cf93-4598-aa91-1607916364f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 08:07:12 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e111ed74-98e5-42f3-81e3-0e32caf355b8]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:07:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7" returned: 0 in 0.562s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:13 devstack quobyte-client[83219]: System call of process 101899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:07:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a" returned: 0 in 0.229s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7.a391d429-7a9e-4fac-bb64-3c800712ac0a" returned: 0 in 0.082s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:13 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Lock "cinder-quobyte-a391d429-7a9e-4fac-bb64-3c800712ac0a" released by "_delete_snapshot" :: held 1.648s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:13 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Lock "cinder-quobyte-61f238b1-cf93-4598-aa91-1607916364f7" released by "delete_snapshot" :: held 1.668s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:13 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Created reservations ['17458fed-4693-473e-8774-9b1e04650144', '09f703fc-d054-4114-87cb-3520c5382502', '219e9a75-2d6d-411c-9cc2-2e774dc8eb3e', '0aee1a7a-9bd1-4f04-9977-6504a36042dd'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:07:14 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Delete snapshot completed successfully. Sep 17 08:07:14 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b99261b8-2c2a-4753-b146-840b7b2cb1b2 tempest-CinderUnicodeTest-1002048456 None] Lock "cinder-a391d429-7a9e-4fac-bb64-3c800712ac0a-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Acquiring lock "cinder-61f238b1-cf93-4598-aa91-1607916364f7-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Lock "cinder-61f238b1-cf93-4598-aa91-1607916364f7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:15 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Acquiring lock "cinder-quobyte-61f238b1-cf93-4598-aa91-1607916364f7" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:15 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Lock "cinder-quobyte-61f238b1-cf93-4598-aa91-1607916364f7" acquired by "delete_volume" :: waited 0.011s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:15 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70b874a-94a4-4632-a314-293c345812dd]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:07:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7" returned: 0 in 0.404s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-61f238b1-cf93-4598-aa91-1607916364f7" returned: 0 in 0.084s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:16 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Lock "cinder-quobyte-61f238b1-cf93-4598-aa91-1607916364f7" released by "delete_volume" :: held 0.662s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:16 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Created reservations ['08d0c558-51c0-4fb2-bb6b-beb61afec6c9', 'def73fe7-6e6a-4d7b-a38e-e3e5ad7c4868', 'e24b2197-445a-4536-b468-83e9ac14e90d', 'e17215c4-37fe-4edc-b69c-e15d8eefcdc7'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:07:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:07:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:07:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.085s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:16 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:07:17 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Deleted volume successfully. Sep 17 08:07:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e94ce386-5517-4d5c-b5bd-420bf3c5e02d tempest-CinderUnicodeTest-1002048456 None] Lock "cinder-61f238b1-cf93-4598-aa91-1607916364f7-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Acquiring lock "cinder-2d37772e-400e-4307-b8a8-de4cdef69fd0-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Lock "cinder-2d37772e-400e-4307-b8a8-de4cdef69fd0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:17 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Acquiring lock "cinder-quobyte-2d37772e-400e-4307-b8a8-de4cdef69fd0" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:17 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Lock "cinder-quobyte-2d37772e-400e-4307-b8a8-de4cdef69fd0" acquired by "delete_volume" :: waited 0.014s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:17 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d1815b-4869-4855-931d-601858643dcc]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:07:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2d37772e-400e-4307-b8a8-de4cdef69fd0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2d37772e-400e-4307-b8a8-de4cdef69fd0" returned: 0 in 0.431s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2d37772e-400e-4307-b8a8-de4cdef69fd0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2d37772e-400e-4307-b8a8-de4cdef69fd0" returned: 0 in 0.086s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:18 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Lock "cinder-quobyte-2d37772e-400e-4307-b8a8-de4cdef69fd0" released by "delete_volume" :: held 0.669s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:18 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Created reservations ['15134520-f147-4643-9224-cbf36457dc8d', 'af05f48a-f538-4954-9492-3450fc2bdd0f', 'd6ae9bec-2da0-40ee-bfdf-6da3dd75c8a4', '7843efac-c071-4898-8741-2e051d6ce7c5'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:07:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:07:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:07:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.083s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:19 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:07:19 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Deleted volume successfully. Sep 17 08:07:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9bf66e8e-8cf0-4e99-8a9c-540973614860 tempest-CinderUnicodeTest-1002048456 None] Lock "cinder-2d37772e-400e-4307-b8a8-de4cdef69fd0-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:28 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 08:07:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:07:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:07:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.125s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:07:28 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=51,cinder:UPDATE=76,cinder:DELETE=7,cinder:INSERT=16 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:07:29 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=77,cinder:DELETE=8,cinder:SELECT=45,cinder:INSERT=16 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:07:39 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Flow 'volume_create_manager' (2b93ac30-25b7-4b41-97fb-5f871377082f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def475ac-3d41-49f9-9dde-14597d7de84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def475ac-3d41-49f9-9dde-14597d7de84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-309615660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daffddc5-5128-47d7-a14b-ee2b7d0cc0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92ecb771fd444609a62ef4e3eac8567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:39Z,use_quota=True,user_id='7fe309f3852742ec9a1e0f59dc9d8e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6badba76-e776-44ef-ab58-cea828c25223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6badba76-e776-44ef-ab58-cea828c25223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ef2e87-93fe-43a0-a5b4-eb01ad947ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ef2e87-93fe-43a0-a5b4-eb01ad947ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daffddc5-5128-47d7-a14b-ee2b7d0cc0b7', 'volume_name': 'volume-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae4be6d-3221-46de-83a8-32bff4e879d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae4be6d-3221-46de-83a8-32bff4e879d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98beedff-fbac-43ee-bf5a-02483a067a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:39 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Volume daffddc5-5128-47d7-a14b-ee2b7d0cc0b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7', 'volume_size': 1} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-309615660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daffddc5-5128-47d7-a14b-ee2b7d0cc0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92ecb771fd444609a62ef4e3eac8567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:39Z,use_quota=True,user_id='7fe309f3852742ec9a1e0f59dc9d8e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Creating volume daffddc5-5128-47d7-a14b-ee2b7d0cc0b7 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:07:39 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:07:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:39 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=146, name=volume-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:07:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7 1073741824" returned: 0 in 0.888s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:40 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:40 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:07:40 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Flow 'volume_create_manager' (22bc338e-a446-464a-be42-25d554fc3821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26e7aa2-0cea-4026-b3a1-59f79d1884a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:41 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Flow 'volume_create_manager' (c0295a81-3a58-471f-aa41-22a1bb5bc313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd24631-1c87-408d-b7c4-c6f091050d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e26e7aa2-0cea-4026-b3a1-59f79d1884a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1888101854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51a1288-a0cd-431f-b376-823a38855a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92ecb771fd444609a62ef4e3eac8567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:39Z,use_quota=True,user_id='7fe309f3852742ec9a1e0f59dc9d8e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd8c672-67bc-4b69-b6e8-8669e4a0b86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd8c672-67bc-4b69-b6e8-8669e4a0b86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42998084-5c14-4c22-af4d-dff2fffd5811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42998084-5c14-4c22-af4d-dff2fffd5811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b51a1288-a0cd-431f-b376-823a38855a63', 'volume_name': 'volume-b51a1288-a0cd-431f-b376-823a38855a63', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8487fd18-a066-430a-b250-e65929d2e1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8487fd18-a066-430a-b250-e65929d2e1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e612158-4bfc-4593-8fe2-fd899a63369e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:41 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Volume b51a1288-a0cd-431f-b376-823a38855a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b51a1288-a0cd-431f-b376-823a38855a63', 'volume_size': 1} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efd24631-1c87-408d-b7c4-c6f091050d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1804743118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6849475c-0c6d-40af-bdf1-f48e2ccc8e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92ecb771fd444609a62ef4e3eac8567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:40Z,use_quota=True,user_id='7fe309f3852742ec9a1e0f59dc9d8e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc9a968-a043-4438-868d-044ad752841b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc9a968-a043-4438-868d-044ad752841b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e401746e-2798-4940-aa35-1572243d2796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e401746e-2798-4940-aa35-1572243d2796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6849475c-0c6d-40af-bdf1-f48e2ccc8e2f', 'volume_name': 'volume-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ef2993-9b00-4ef4-bc35-c652d48b2758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ef2993-9b00-4ef4-bc35-c652d48b2758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42da7b98-b5c0-4896-a09d-6a7c8fa33209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:41 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Volume 6849475c-0c6d-40af-bdf1-f48e2ccc8e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f', 'volume_size': 1} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7" returned: 0 in 1.143s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] <== create_volume: return (2141ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.104s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1888101854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51a1288-a0cd-431f-b376-823a38855a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92ecb771fd444609a62ef4e3eac8567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:39Z,use_quota=True,user_id='7fe309f3852742ec9a1e0f59dc9d8e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Creating volume b51a1288-a0cd-431f-b376-823a38855a63 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:07:41 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:07:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b51a1288-a0cd-431f-b376-823a38855a63 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:42 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=147, name=volume-b51a1288-a0cd-431f-b376-823a38855a63, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98beedff-fbac-43ee-bf5a-02483a067a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5bd450-5ba7-4951-b582-ec560db51770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:42 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Flow 'volume_create_manager' (3c5d6e5c-4933-496b-a49b-c230c4c9314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6f1567-8320-42e6-a12a-f7b92a28f847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:42 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Flow 'volume_create_manager' (7def8aa5-a500-4bf1-8c68-2230c83958d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafaae70-8461-4c3c-bdc9-85b0f45c520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafaae70-8461-4c3c-bdc9-85b0f45c520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326729924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171d709c-60ed-4f5f-97ff-7971c9541ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92ecb771fd444609a62ef4e3eac8567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:41Z,use_quota=True,user_id='7fe309f3852742ec9a1e0f59dc9d8e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98720a17-c4bd-416f-b75a-ac9a0698633a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98720a17-c4bd-416f-b75a-ac9a0698633a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87195496-270f-4d4c-a8e2-d669e14de4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87195496-270f-4d4c-a8e2-d669e14de4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '171d709c-60ed-4f5f-97ff-7971c9541ebc', 'volume_name': 'volume-171d709c-60ed-4f5f-97ff-7971c9541ebc', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379a672c-6c75-4503-a0b8-3a966f5337e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379a672c-6c75-4503-a0b8-3a966f5337e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab41013d-3fe4-4465-9aa6-ccdd903cfe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:42 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Volume 171d709c-60ed-4f5f-97ff-7971c9541ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-171d709c-60ed-4f5f-97ff-7971c9541ebc', 'volume_size': 1} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b51a1288-a0cd-431f-b376-823a38855a63 1073741824" returned: 0 in 0.941s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b51a1288-a0cd-431f-b376-823a38855a63 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:42 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Volume volume-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7 (daffddc5-5128-47d7-a14b-ee2b7d0cc0b7): created successfully Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5bd450-5ba7-4951-b582-ec560db51770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:42 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Flow 'volume_create_manager' (2b93ac30-25b7-4b41-97fb-5f871377082f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e6f1567-8320-42e6-a12a-f7b92a28f847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1974365354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c995b5e-e583-4d5b-b3ba-06c96e2469c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92ecb771fd444609a62ef4e3eac8567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:41Z,use_quota=True,user_id='7fe309f3852742ec9a1e0f59dc9d8e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21995eb1-c58e-4126-9036-205d4bead17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21995eb1-c58e-4126-9036-205d4bead17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ab5020-dcf2-44c8-99e7-c3c6b56dfb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ab5020-dcf2-44c8-99e7-c3c6b56dfb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c995b5e-e583-4d5b-b3ba-06c96e2469c3', 'volume_name': 'volume-5c995b5e-e583-4d5b-b3ba-06c96e2469c3', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e96ec3-a5fe-45fe-97bd-455461d23a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e96ec3-a5fe-45fe-97bd-455461d23a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8b0067-5652-4c76-90a4-e48d907f5645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:43 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Volume 5c995b5e-e583-4d5b-b3ba-06c96e2469c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c995b5e-e583-4d5b-b3ba-06c96e2469c3', 'volume_size': 1} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:43 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-68ada908-4127-47c5-8588-2b06a76a0258 tempest-CreateVolumesFromImageTest-1266504592 None] Created volume successfully. Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b51a1288-a0cd-431f-b376-823a38855a63" returned: 0 in 0.544s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] <== create_volume: return (1512ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.608s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1804743118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6849475c-0c6d-40af-bdf1-f48e2ccc8e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92ecb771fd444609a62ef4e3eac8567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:40Z,use_quota=True,user_id='7fe309f3852742ec9a1e0f59dc9d8e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Creating volume 6849475c-0c6d-40af-bdf1-f48e2ccc8e2f {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:07:43 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:43 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=148, name=volume-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e612158-4bfc-4593-8fe2-fd899a63369e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b51a1288-a0cd-431f-b376-823a38855a63', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0f9d33-5f65-4d73-b84d-300af702acea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:43 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Volume volume-b51a1288-a0cd-431f-b376-823a38855a63 (b51a1288-a0cd-431f-b376-823a38855a63): created successfully Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0f9d33-5f65-4d73-b84d-300af702acea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Flow 'volume_create_manager' (22bc338e-a446-464a-be42-25d554fc3821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f 1073741824" returned: 0 in 0.623s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:44 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5775310d-42e7-4792-8ecc-0eb0d9fa1dd3 tempest-CreateVolumesFromImageTest-1266504592 None] Created volume successfully. Sep 17 08:07:44 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Flow 'volume_create_manager' (5f81c3a7-9549-4a87-a921-11f1e940317c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d580950c-6ba4-4942-9aed-efe56d26c71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f" returned: 0 in 0.533s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d580950c-6ba4-4942-9aed-efe56d26c71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5e8a5d-eebe-4911-85a1-09e7a58aed63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8edf59b74a4d6db778bfd670d96f1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:43Z,use_quota=True,user_id='96c57e92e86d4ca087ac80b675de439e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed8e8b7-7504-4c63-95d9-baf3e71a2060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed8e8b7-7504-4c63-95d9-baf3e71a2060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4164dc0-2390-4692-b133-55746bfb4c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] <== create_volume: return (1278ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.942s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326729924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171d709c-60ed-4f5f-97ff-7971c9541ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92ecb771fd444609a62ef4e3eac8567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:41Z,use_quota=True,user_id='7fe309f3852742ec9a1e0f59dc9d8e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Creating volume 171d709c-60ed-4f5f-97ff-7971c9541ebc {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:07:44 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:07:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-171d709c-60ed-4f5f-97ff-7971c9541ebc 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:44 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=149, name=volume-171d709c-60ed-4f5f-97ff-7971c9541ebc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42da7b98-b5c0-4896-a09d-6a7c8fa33209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df557cfa-9179-4e2b-8cbd-05b2ca63db91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:45 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Volume volume-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f (6849475c-0c6d-40af-bdf1-f48e2ccc8e2f): created successfully Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df557cfa-9179-4e2b-8cbd-05b2ca63db91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Flow 'volume_create_manager' (c0295a81-3a58-471f-aa41-22a1bb5bc313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-171d709c-60ed-4f5f-97ff-7971c9541ebc 1073741824" returned: 0 in 0.693s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-171d709c-60ed-4f5f-97ff-7971c9541ebc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:45 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-701977dc-e497-4c9c-9dce-35a07448dfb2 tempest-CreateVolumesFromImageTest-1266504592 None] Created volume successfully. Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-171d709c-60ed-4f5f-97ff-7971c9541ebc" returned: 0 in 0.437s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] <== create_volume: return (1166ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4164dc0-2390-4692-b133-55746bfb4c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc5e8a5d-eebe-4911-85a1-09e7a58aed63', 'volume_name': 'volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63', 'volume_size': 1, 'image_id': 'e0dadcfa-79eb-42bd-a5ed-0732d9d70737', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f7c5262406461060f533af7e6d4e2143', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f8edf59b74a4d6db778bfd670d96f1d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '578f40ae719673ca5ee9d2879a7a6766eb085f6c9e689fd35c00dc248ff767b3587c4c177cf5053f0e916497d612dab7a66c6906daffbaca5b584098f2ba21d8', 'id': 'e0dadcfa-79eb-42bd-a5ed-0732d9d70737', 'created_at': datetime.datetime(2025, 9, 17, 6, 7, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 6, 7, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0dadcfa-79eb-42bd-a5ed-0732d9d70737/file', 'properties': {}}, 'image_service': }' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf17480-91f8-4cbb-9242-f06fc9111a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf17480-91f8-4cbb-9242-f06fc9111a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eead6e2-3d4b-4af1-a9d0-0e0eeb679eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:45 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Volume cc5e8a5d-eebe-4911-85a1-09e7a58aed63: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63', 'volume_size': 1, 'image_id': 'e0dadcfa-79eb-42bd-a5ed-0732d9d70737', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f7c5262406461060f533af7e6d4e2143', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f8edf59b74a4d6db778bfd670d96f1d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '578f40ae719673ca5ee9d2879a7a6766eb085f6c9e689fd35c00dc248ff767b3587c4c177cf5053f0e916497d612dab7a66c6906daffbaca5b584098f2ba21d8', 'id': 'e0dadcfa-79eb-42bd-a5ed-0732d9d70737', 'created_at': datetime.datetime(2025, 9, 17, 6, 7, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 6, 7, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0dadcfa-79eb-42bd-a5ed-0732d9d70737/file', 'properties': {}}, 'image_service': } Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Cloning cc5e8a5d-eebe-4911-85a1-09e7a58aed63 from image e0dadcfa-79eb-42bd-a5ed-0732d9d70737 at location (None, None). {{(pid=83207) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1074}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.790s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1974365354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c995b5e-e583-4d5b-b3ba-06c96e2469c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e92ecb771fd444609a62ef4e3eac8567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:41Z,use_quota=True,user_id='7fe309f3852742ec9a1e0f59dc9d8e28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Creating volume 5c995b5e-e583-4d5b-b3ba-06c96e2469c3 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:07:45 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:07:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5c995b5e-e583-4d5b-b3ba-06c96e2469c3 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:46 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=150, name=volume-5c995b5e-e583-4d5b-b3ba-06c96e2469c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:07:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab41013d-3fe4-4465-9aa6-ccdd903cfe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-171d709c-60ed-4f5f-97ff-7971c9541ebc', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5454bc9-7be7-45ac-a950-4d941a567f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:46 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Volume volume-171d709c-60ed-4f5f-97ff-7971c9541ebc (171d709c-60ed-4f5f-97ff-7971c9541ebc): created successfully Sep 17 08:07:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5454bc9-7be7-45ac-a950-4d941a567f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:46 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Flow 'volume_create_manager' (7def8aa5-a500-4bf1-8c68-2230c83958d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5c995b5e-e583-4d5b-b3ba-06c96e2469c3 1073741824" returned: 0 in 0.569s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5c995b5e-e583-4d5b-b3ba-06c96e2469c3 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:46 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-0fc61e47-f485-41cc-948f-fd51b86a29ec tempest-CreateVolumesFromImageTest-1266504592 None] Created volume successfully. Sep 17 08:07:46 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 17 08:07:46 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Image download 0.00 MB at 0.00 MB/s Sep 17 08:07:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5c995b5e-e583-4d5b-b3ba-06c96e2469c3" returned: 0 in 0.437s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] <== create_volume: return (1053ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:07:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:47 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3492435c-eca2-413c-852d-1f59625c847a]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:07:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8b0067-5652-4c76-90a4-e48d907f5645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c995b5e-e583-4d5b-b3ba-06c96e2469c3', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b89bf9e-7383-4bd6-896c-f75577b89458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:07:47 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Volume volume-5c995b5e-e583-4d5b-b3ba-06c96e2469c3 (5c995b5e-e583-4d5b-b3ba-06c96e2469c3): created successfully Sep 17 08:07:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b89bf9e-7383-4bd6-896c-f75577b89458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:07:47 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Flow 'volume_create_manager' (3c5d6e5c-4933-496b-a49b-c230c4c9314b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:07:47 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD Sep 17 08:07:47 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-c9a16afb-4709-43b1-b1c1-45d98aca8957 tempest-CreateVolumesFromImageTest-1266504592 None] Created volume successfully. Sep 17 08:07:47 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 08:07:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "cinder-171d709c-60ed-4f5f-97ff-7971c9541ebc-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-171d709c-60ed-4f5f-97ff-7971c9541ebc-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:49 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "cinder-quobyte-171d709c-60ed-4f5f-97ff-7971c9541ebc" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-quobyte-171d709c-60ed-4f5f-97ff-7971c9541ebc" acquired by "delete_volume" :: waited 0.049s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:49 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bed3547-b7f3-4b2d-b33c-05f1f217640d]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:07:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-171d709c-60ed-4f5f-97ff-7971c9541ebc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:50 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 17 08:07:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD" returned: 0 in 2.967s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-171d709c-60ed-4f5f-97ff-7971c9541ebc" returned: 0 in 0.835s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-171d709c-60ed-4f5f-97ff-7971c9541ebc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-171d709c-60ed-4f5f-97ff-7971c9541ebc" returned: 0 in 0.269s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:50 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD Sep 17 08:07:50 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 08:07:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-quobyte-171d709c-60ed-4f5f-97ff-7971c9541ebc" released by "delete_volume" :: held 1.452s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:51 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Created reservations ['6b6b7b11-7124-4892-88e1-4a578a50f4c8', 'cd2bfca4-a7a8-4aa7-8133-0e4e00ac7c9c', '10dfb6cd-1a36-4435-9cd5-27bf8ad6fee7', 'bf1fd35e-f48a-4362-a79d-488dfb317e3f'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:07:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:51 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:07:51 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:07:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.255s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:52 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:07:52 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Deleted volume successfully. Sep 17 08:07:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-7791a199-a4a7-4864-850f-deb85bc63119 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-171d709c-60ed-4f5f-97ff-7971c9541ebc-delete_volume" released by "delete_volume" :: held 3.494s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "cinder-5c995b5e-e583-4d5b-b3ba-06c96e2469c3-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-5c995b5e-e583-4d5b-b3ba-06c96e2469c3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:52 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "cinder-quobyte-5c995b5e-e583-4d5b-b3ba-06c96e2469c3" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-quobyte-5c995b5e-e583-4d5b-b3ba-06c96e2469c3" acquired by "delete_volume" :: waited 0.014s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:52 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8f76c5-d966-4d56-bf21-b1fff490ac2d]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:07:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5c995b5e-e583-4d5b-b3ba-06c96e2469c3 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:53 devstack quobyte-client[83219]: System call of process 102034 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:07:53 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Sep 17 08:07:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5c995b5e-e583-4d5b-b3ba-06c96e2469c3" returned: 0 in 1.020s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5c995b5e-e583-4d5b-b3ba-06c96e2469c3 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD" returned: 1 in 3.909s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:07:54 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Temporary image e0dadcfa-79eb-42bd-a5ed-0732d9d70737 is fetched for user 96c57e92e86d4ca087ac80b675de439e. {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 17 08:07:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5c995b5e-e583-4d5b-b3ba-06c96e2469c3" returned: 0 in 0.274s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-quobyte-5c995b5e-e583-4d5b-b3ba-06c96e2469c3" released by "delete_volume" :: held 1.442s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:54 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b53bd0-4670-4e4c-b413-f69f348f8914]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:07:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:54 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Created reservations ['b8974624-4479-41aa-941b-0eef560a4e15', '1ad54b71-54f2-41f3-8c1f-8309e3befb0b', 'da3a0a31-11d8-4b8a-b10f-88ec877ecc1b', '8d1870d5-2fb1-4914-86eb-f73ae161b8cf'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:07:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:55 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:07:55 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:07:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:55 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD Sep 17 08:07:55 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 08:07:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.118s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:55 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:07:55 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Deleted volume successfully. Sep 17 08:07:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-0825e5b8-2e70-485c-aade-a78d91479de5 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-5c995b5e-e583-4d5b-b3ba-06c96e2469c3-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "cinder-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:56 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "cinder-quobyte-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-quobyte-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f" acquired by "delete_volume" :: waited 0.011s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:56 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bad356d-49d5-4bed-ae31-d8d58904d2c4]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:07:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f" returned: 0 in 0.962s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:57 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Sep 17 08:07:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD" returned: 0 in 3.211s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f" returned: 0 in 0.310s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-quobyte-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f" released by "delete_volume" :: held 1.551s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:58 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Created reservations ['88542ce1-f937-42bf-952a-429f7dadf5b3', '15af2150-b038-4ec1-ac97-99e5515f32a3', 'e4434330-2cb5-4408-a2be-32ec6d2d9ab3', '07e6bb2c-0b5b-4d52-adf6-18cb4519651b'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:07:58 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD Sep 17 08:07:58 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 08:07:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:07:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:07:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:07:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:07:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:07:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:07:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.115s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:07:58 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:07:58 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Deleted volume successfully. Sep 17 08:07:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b5f4e9e9-4f82-4982-b6f7-ca424726e6c8 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-6849475c-0c6d-40af-bdf1-f48e2ccc8e2f-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:07:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "cinder-b51a1288-a0cd-431f-b376-823a38855a63-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-b51a1288-a0cd-431f-b376-823a38855a63-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:59 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:07:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "cinder-quobyte-b51a1288-a0cd-431f-b376-823a38855a63" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:07:59 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-quobyte-b51a1288-a0cd-431f-b376-823a38855a63" acquired by "delete_volume" :: waited 0.014s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:07:59 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d39acd2-61ec-4bec-a070-5487b2be1030]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:07:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b51a1288-a0cd-431f-b376-823a38855a63 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:00 devstack quobyte-client[83219]: System call of process 102054 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b51a1288-a0cd-431f-b376-823a38855a63" returned: 0 in 0.726s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b51a1288-a0cd-431f-b376-823a38855a63 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-b51a1288-a0cd-431f-b376-823a38855a63" returned: 0 in 0.324s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:01 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-quobyte-b51a1288-a0cd-431f-b376-823a38855a63" released by "delete_volume" :: held 1.301s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD" returned: 1 in 3.467s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5e8a5d-eebe-4911-85a1-09e7a58aed63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f8edf59b74a4d6db778bfd670d96f1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:07:43Z,use_quota=True,user_id='96c57e92e86d4ca087ac80b675de439e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Creating volume cc5e8a5d-eebe-4911-85a1-09e7a58aed63 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:08:01 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:08:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:01 devstack quobyte-client[83219]: System call of process 102063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:01 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=151, name=volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:02 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Created reservations ['78c0bf75-6dcb-4c08-8595-5cc0d504ce00', 'bf6469e9-8e56-4bff-a39a-0a1b2458e5c8', '183dd0a2-1115-4eec-ac9a-b7d99ed08109', 'a7366c05-dc36-48f7-9812-1f1a3c1dfec7'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:08:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63 1073741824" returned: 0 in 0.677s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63" returned: 0 in 0.356s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:02 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] <== create_volume: return (1098ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:08:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:02 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Attempting download of e0dadcfa-79eb-42bd-a5ed-0732d9d70737 ((None, None)) to volume cc5e8a5d-eebe-4911-85a1-09e7a58aed63. {{(pid=83207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 17 08:08:03 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c48c3b1-3c6c-4fc3-92b0-bf8e801ce973]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_39f183p5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.035s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:03 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "cinder-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.518s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:03 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:08:03 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Deleted volume successfully. Sep 17 08:08:03 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7-delete_volume" acquired by "delete_volume" :: waited 0.232s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_39f183p5" returned: 0 in 0.967s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_39f183p5 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-284280b4-6965-4688-9117-6815b1825e64 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-b51a1288-a0cd-431f-b376-823a38855a63-delete_volume" released by "delete_volume" :: held 4.420s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:04 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "cinder-quobyte-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_39f183p5" returned: 1 in 0.727s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_39f183p5' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:08:04 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c715a2d-7f7e-481b-bd0f-f3ae12096135]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-quobyte-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7" acquired by "delete_volume" :: waited 0.067s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:04 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f37dde-0817-49a0-9b72-b57a3f31855a]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD" returned: 0 in 0.557s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7" returned: 0 in 0.667s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:05 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7" returned: 0 in 0.190s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:06 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-quobyte-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7" released by "delete_volume" :: held 1.383s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD" returned: 1 in 1.081s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:08:06 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] e0dadcfa-79eb-42bd-a5ed-0732d9d70737 was raw, converting to raw {{(pid=83207) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 17 08:08:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:06 devstack quobyte-client[83219]: System call of process 102082 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:06 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=151, name=volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63" returned: 0 in 0.391s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:06 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e0dadcfa-79eb-42bd-a5ed-0732d9d70737_b1cz_qwhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63 {{(pid=83207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 08:08:06 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 08:08:06 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:07 devstack quobyte-client[83219]: System call of process 102085 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:07 devstack quobyte-client[83219]: System call of process 102085 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:07 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Created reservations ['06a7643b-4fda-4e40-9d12-3fdda8a4dc28', '4a579a14-115d-49df-b071-e9fe2bf07741', '193a25a0-4fa3-448b-93ca-e81b83b3fb78', '8c833867-6483-4b53-b020-a8ce87abc328'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:08:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63 1G" returned: 0 in 0.390s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:07 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dde985-3391-4199-ae91-803add7aa8b1]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.028s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:07 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:07 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.162s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:08 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:08:08 devstack quobyte-client[83219]: System call of process 102088 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:08 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Deleted volume successfully. Sep 17 08:08:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63" returned: 0 in 0.886s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:08 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-4486085c-9782-449f-92b4-f8bff2e5c6c4 tempest-CreateVolumesFromImageTest-1266504592 None] Lock "cinder-daffddc5-5128-47d7-a14b-ee2b7d0cc0b7-delete_volume" released by "delete_volume" :: held 4.608s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63" returned: 1 in 0.586s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:08 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:08:08 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Downloaded image e0dadcfa-79eb-42bd-a5ed-0732d9d70737 ((None, None)) to volume cc5e8a5d-eebe-4911-85a1-09e7a58aed63 successfully. {{(pid=83207) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 17 08:08:08 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Temporary image e0dadcfa-79eb-42bd-a5ed-0732d9d70737 for user 96c57e92e86d4ca087ac80b675de439e is deleted. {{(pid=83207) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 17 08:08:08 devstack cinder-volume[83207]: DEBUG cinder.volume.volume_utils [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Marking volume cc5e8a5d-eebe-4911-85a1-09e7a58aed63 as bootable. {{(pid=83207) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 17 08:08:09 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Copying metadata from image e0dadcfa-79eb-42bd-a5ed-0732d9d70737 to cc5e8a5d-eebe-4911-85a1-09e7a58aed63. {{(pid=83207) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 08:08:09 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Creating volume glance metadata for volume cc5e8a5d-eebe-4911-85a1-09e7a58aed63 backed by image e0dadcfa-79eb-42bd-a5ed-0732d9d70737 with: {'image_id': 'e0dadcfa-79eb-42bd-a5ed-0732d9d70737', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f7c5262406461060f533af7e6d4e2143', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83207) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 08:08:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eead6e2-3d4b-4af1-a9d0-0e0eeb679eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63', 'volume_size': 1, 'image_id': 'e0dadcfa-79eb-42bd-a5ed-0732d9d70737', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f7c5262406461060f533af7e6d4e2143', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3f8edf59b74a4d6db778bfd670d96f1d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '578f40ae719673ca5ee9d2879a7a6766eb085f6c9e689fd35c00dc248ff767b3587c4c177cf5053f0e916497d612dab7a66c6906daffbaca5b584098f2ba21d8', 'id': 'e0dadcfa-79eb-42bd-a5ed-0732d9d70737', 'created_at': datetime.datetime(2025, 9, 17, 6, 7, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 17, 6, 7, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e0dadcfa-79eb-42bd-a5ed-0732d9d70737/file', 'properties': {}}, 'image_service': }' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a75a2d7-5cac-4fac-8010-3b72d116639e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:09 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Volume volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63 (cc5e8a5d-eebe-4911-85a1-09e7a58aed63): created successfully Sep 17 08:08:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a75a2d7-5cac-4fac-8010-3b72d116639e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Flow 'volume_create_manager' (5f81c3a7-9549-4a87-a921-11f1e940317c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:09 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-3edb42ff-663d-4594-ae75-dc0e6950bc38 tempest-VolumeImageDependencyTests-1626085833 None] Created volume successfully. Sep 17 08:08:10 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Acquiring lock "cinder-cc5e8a5d-eebe-4911-85a1-09e7a58aed63-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:10 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Lock "cinder-cc5e8a5d-eebe-4911-85a1-09e7a58aed63-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:10 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:10 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Acquiring lock "cinder-quobyte-cc5e8a5d-eebe-4911-85a1-09e7a58aed63" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:10 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Lock "cinder-quobyte-cc5e8a5d-eebe-4911-85a1-09e7a58aed63" acquired by "delete_volume" :: waited 0.017s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:10 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9d8094-c514-4ef3-84d0-c34c05a94dc5]: (4, 'raw') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:10 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63" returned: 0 in 0.536s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:11 devstack quobyte-client[83219]: System call of process 102096 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63" returned: 1 in 0.610s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63' failed. Not Retrying. {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 17 08:08:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-cc5e8a5d-eebe-4911-85a1-09e7a58aed63" returned: 0 in 0.131s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:12 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Lock "cinder-quobyte-cc5e8a5d-eebe-4911-85a1-09e7a58aed63" released by "delete_volume" :: held 1.668s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Created reservations ['05aff13c-2a81-42d6-bcec-e0c42fc08eae', '31dba9da-5b1e-47d7-b2c2-1cbc90722322', 'edf1a829-2a00-46cc-a801-bdbc9cb6086b', 'c59c56c8-8e44-40e2-b8b7-79f0720aa8d0'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:08:13 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Flow 'volume_create_manager' (db868a86-180e-48e5-b6b8-5ace911a00c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68db7b4-31e7-4e9a-97b6-0661c8e8f2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a68db7b4-31e7-4e9a-97b6-0661c8e8f2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1669884998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5281d188-24a5-436e-b5a8-8f66836ca336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc5f61e96ba4996ba876012509418bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:13Z,use_quota=True,user_id='8fbf88dfa38c483384c95935a57a2983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b173bd21-2042-42f9-add4-915f699047f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b173bd21-2042-42f9-add4-915f699047f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120a4023-d83e-4298-97b7-99844a479264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120a4023-d83e-4298-97b7-99844a479264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5281d188-24a5-436e-b5a8-8f66836ca336', 'volume_name': 'volume-5281d188-24a5-436e-b5a8-8f66836ca336', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5abab6f6-dcb3-4b9e-aad4-883c7293da44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5abab6f6-dcb3-4b9e-aad4-883c7293da44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78a3623-2a9d-406d-b54e-5eb8872e6ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:13 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume 5281d188-24a5-436e-b5a8-8f66836ca336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5281d188-24a5-436e-b5a8-8f66836ca336', 'volume_size': 1} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1669884998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5281d188-24a5-436e-b5a8-8f66836ca336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc5f61e96ba4996ba876012509418bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:13Z,use_quota=True,user_id='8fbf88dfa38c483384c95935a57a2983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Creating volume 5281d188-24a5-436e-b5a8-8f66836ca336 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:08:13 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.034s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:13 devstack quobyte-client[83219]: System call of process 102101 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:13 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=152, name=volume-5281d188-24a5-436e-b5a8-8f66836ca336, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.299s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:14 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:08:14 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Deleted volume successfully. Sep 17 08:08:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336 1073741824" returned: 0 in 0.831s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:14 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b578d91b-4efe-46f4-ad3f-5eaec6bdf772 tempest-VolumeImageDependencyTests-1626085833 None] Lock "cinder-cc5e8a5d-eebe-4911-85a1-09e7a58aed63-delete_volume" released by "delete_volume" :: held 4.341s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336" returned: 0 in 0.437s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] <== create_volume: return (1286ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:08:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78a3623-2a9d-406d-b54e-5eb8872e6ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5281d188-24a5-436e-b5a8-8f66836ca336', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894cf9aa-2a0d-41ac-b368-3c3ec591d534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:15 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume volume-5281d188-24a5-436e-b5a8-8f66836ca336 (5281d188-24a5-436e-b5a8-8f66836ca336): created successfully Sep 17 08:08:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894cf9aa-2a0d-41ac-b368-3c3ec591d534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Flow 'volume_create_manager' (db868a86-180e-48e5-b6b8-5ace911a00c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:15 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-efc624dc-87b1-4f9e-9563-306b675c204d tempest-CreateVolumesFromSnapshotTest-902284424 None] Created volume successfully. Sep 17 08:08:16 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] Creating offline snapshot a6c271ec-bf78-4bef-90b8-8c255aa0814b of volume 5281d188-24a5-436e-b5a8-8f66836ca336 {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 08:08:16 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5b5c03-fe01-4fc7-8e86-0a4fc9d3c768]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:17 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:17 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:08:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Flow 'volume_create_manager' (63bd3ddb-2f3e-4e34-9db9-674f43ddc1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1794a49f-e515-40b0-a1e5-5422b031fd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1794a49f-e515-40b0-a1e5-5422b031fd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-581641235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bff0236-8119-4612-b0d2-1b04bc60c06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f6c0c027f64ca3a4afb23f8be973ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:17Z,use_quota=True,user_id='1713b32082ea49788a850dc761ba8b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957ec518-c9f5-49d1-9488-2d4c9a18ba78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957ec518-c9f5-49d1-9488-2d4c9a18ba78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de33738e-0cec-474a-89ee-119c27310bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de33738e-0cec-474a-89ee-119c27310bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bff0236-8119-4612-b0d2-1b04bc60c06b', 'volume_name': 'volume-6bff0236-8119-4612-b0d2-1b04bc60c06b', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37fedb9-bae3-41e1-bcac-40067be9e914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c37fedb9-bae3-41e1-bcac-40067be9e914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74b1590-0fdd-4552-8625-ee7f345a4c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:17 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Volume 6bff0236-8119-4612-b0d2-1b04bc60c06b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bff0236-8119-4612-b0d2-1b04bc60c06b', 'volume_size': 1} Sep 17 08:08:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336" returned: 0 in 0.935s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:18 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=153, name=volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b 1G" returned: 0 in 0.256s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5281d188-24a5-436e-b5a8-8f66836ca336 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:18 devstack quobyte-client[83219]: System call of process 102113 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "qemu-img rebase -u -b volume-5281d188-24a5-436e-b5a8-8f66836ca336 -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b" returned: 0 in 0.192s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 08:08:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b" returned: 0 in 0.087s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336 -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 08:08:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b" returned: 0 in 0.438s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:19 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Flow 'volume_create_manager' (6b59fcbf-e394-447f-941f-49ea75150748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d554dbe7-df5e-481e-8dc9-cd038f18fc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.info" returned: 0 in 0.448s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d554dbe7-df5e-481e-8dc9-cd038f18fc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619690fa-61a8-42d9-93a2-d192c5302495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef6caa38dd64fdba1174f957d9b3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:19Z,use_quota=True,user_id='20e49a6052df40a9b6dd0426d0a9e075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4758fd64-9ab4-428d-9102-99a04c35d630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4758fd64-9ab4-428d-9102-99a04c35d630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabc962d-5db4-4a65-bc70-8422bf31fe77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabc962d-5db4-4a65-bc70-8422bf31fe77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '619690fa-61a8-42d9-93a2-d192c5302495', 'volume_name': 'volume-619690fa-61a8-42d9-93a2-d192c5302495', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c82a35f-a452-4fba-b8ad-6b09ec6a26fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c82a35f-a452-4fba-b8ad-6b09ec6a26fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9558ff6b-df51-4271-9d58-69e10c7fce76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:19 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Volume 619690fa-61a8-42d9-93a2-d192c5302495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-619690fa-61a8-42d9-93a2-d192c5302495', 'volume_size': 1} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.info" returned: 0 in 0.319s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.961s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.059s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-581641235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bff0236-8119-4612-b0d2-1b04bc60c06b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f6c0c027f64ca3a4afb23f8be973ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:17Z,use_quota=True,user_id='1713b32082ea49788a850dc761ba8b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Creating volume 6bff0236-8119-4612-b0d2-1b04bc60c06b {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:08:19 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:08:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:20 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=155, name=volume-6bff0236-8119-4612-b0d2-1b04bc60c06b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:20 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-172573a2-0db9-4f9d-921c-fa47323c84ab tempest-CreateVolumesFromSnapshotTest-902284424 None] Create snapshot completed successfully Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b 1073741824" returned: 0 in 0.413s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b" returned: 0 in 0.100s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] <== create_volume: return (564ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.583s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619690fa-61a8-42d9-93a2-d192c5302495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef6caa38dd64fdba1174f957d9b3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:19Z,use_quota=True,user_id='20e49a6052df40a9b6dd0426d0a9e075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Creating volume 619690fa-61a8-42d9-93a2-d192c5302495 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:08:20 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-619690fa-61a8-42d9-93a2-d192c5302495 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:20 devstack quobyte-client[83219]: System call of process 102124 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:20 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=156, name=volume-619690fa-61a8-42d9-93a2-d192c5302495, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74b1590-0fdd-4552-8625-ee7f345a4c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bff0236-8119-4612-b0d2-1b04bc60c06b', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:20 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384216bf-4294-4bae-89c2-a5b86988c3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:21 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Volume volume-6bff0236-8119-4612-b0d2-1b04bc60c06b (6bff0236-8119-4612-b0d2-1b04bc60c06b): created successfully Sep 17 08:08:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384216bf-4294-4bae-89c2-a5b86988c3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Flow 'volume_create_manager' (63bd3ddb-2f3e-4e34-9db9-674f43ddc1ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-619690fa-61a8-42d9-93a2-d192c5302495 1073741824" returned: 0 in 0.464s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-619690fa-61a8-42d9-93a2-d192c5302495 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:21 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-bd3e0c1d-81b9-4a53-81ba-eba683fb423c tempest-SnapshotDependencyTests-1838244486 None] Created volume successfully. Sep 17 08:08:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-619690fa-61a8-42d9-93a2-d192c5302495" returned: 0 in 0.406s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:21 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] <== create_volume: return (903ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:08:21 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9558ff6b-df51-4271-9d58-69e10c7fce76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619690fa-61a8-42d9-93a2-d192c5302495', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (629a8d85-e725-4689-b27a-e5e00cac7869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:21 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Volume volume-619690fa-61a8-42d9-93a2-d192c5302495 (619690fa-61a8-42d9-93a2-d192c5302495): created successfully Sep 17 08:08:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (629a8d85-e725-4689-b27a-e5e00cac7869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Flow 'volume_create_manager' (6b59fcbf-e394-447f-941f-49ea75150748) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:21 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:21 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:08:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Flow 'volume_create_manager' (1a42b9a4-f094-4042-a430-e8568c7720ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:21 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111ad163-81bd-4b6f-b9d8-ae9edd35a16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111ad163-81bd-4b6f-b9d8-ae9edd35a16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1566351234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d84f28-f935-472e-a13a-2bcb8d465e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc5f61e96ba4996ba876012509418bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:22Z,use_quota=True,user_id='8fbf88dfa38c483384c95935a57a2983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a083f06d-22a5-4585-8c4e-8adbdd6e7517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a083f06d-22a5-4585-8c4e-8adbdd6e7517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53046f0-ae34-44af-abc5-8d1711d9ffea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53046f0-ae34-44af-abc5-8d1711d9ffea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95d84f28-f935-472e-a13a-2bcb8d465e99', 'volume_name': 'volume-95d84f28-f935-472e-a13a-2bcb8d465e99', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7491a182-bb25-4ef2-b6e5-36ab86a78401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7491a182-bb25-4ef2-b6e5-36ab86a78401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279add7e-c683-4d1d-939a-0bb079902c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:22 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume 95d84f28-f935-472e-a13a-2bcb8d465e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95d84f28-f935-472e-a13a-2bcb8d465e99', 'volume_size': 1} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1566351234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95d84f28-f935-472e-a13a-2bcb8d465e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc5f61e96ba4996ba876012509418bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:22Z,use_quota=True,user_id='8fbf88dfa38c483384c95935a57a2983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Creating volume 95d84f28-f935-472e-a13a-2bcb8d465e99 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:08:22 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-95d84f28-f935-472e-a13a-2bcb8d465e99 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:22 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-acd57bad-720f-42ac-bbb9-1c2a64c19bae tempest-CinderUnicodeTest-726850965 None] Created volume successfully. Sep 17 08:08:22 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=157, name=volume-95d84f28-f935-472e-a13a-2bcb8d465e99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-95d84f28-f935-472e-a13a-2bcb8d465e99 1073741824" returned: 0 in 0.783s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-95d84f28-f935-472e-a13a-2bcb8d465e99 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:23 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Flow 'volume_create_manager' (d1f1ab9a-f3f7-4684-93c6-a2bff6f73aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de1eef5-a366-4cf5-903a-3961488417d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:23 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Flow 'volume_create_manager' (ab7a2edc-82a2-44f9-b0ea-51d7679a047c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f6f04c-2f4f-4fb1-b130-e42e035d7241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:23 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de1eef5-a366-4cf5-903a-3961488417d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-22190957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66551225-43cf-4b15-99b2-1668a2398a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc5f61e96ba4996ba876012509418bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:22Z,use_quota=True,user_id='8fbf88dfa38c483384c95935a57a2983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5fadd1-5f36-4462-8259-80aeb7c3b89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5fadd1-5f36-4462-8259-80aeb7c3b89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ea76bb-832e-413a-8b02-af51626dedbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47ea76bb-832e-413a-8b02-af51626dedbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66551225-43cf-4b15-99b2-1668a2398a8e', 'volume_name': 'volume-66551225-43cf-4b15-99b2-1668a2398a8e', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87616aa-a9a6-4045-8c52-3b8a55f98a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87616aa-a9a6-4045-8c52-3b8a55f98a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77340ac6-29a5-4170-b4f1-eace1030ea7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:23 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume 66551225-43cf-4b15-99b2-1668a2398a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66551225-43cf-4b15-99b2-1668a2398a8e', 'volume_size': 1} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-95d84f28-f935-472e-a13a-2bcb8d465e99" returned: 0 in 0.924s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f6f04c-2f4f-4fb1-b130-e42e035d7241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611609893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a1900e-91b3-459f-8be7-a9eaeaaa7b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc5f61e96ba4996ba876012509418bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:23Z,use_quota=True,user_id='8fbf88dfa38c483384c95935a57a2983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e1bd46-bc08-4ea0-9c6f-a70d22d31545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e1bd46-bc08-4ea0-9c6f-a70d22d31545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51811b3-703d-4a73-a544-7a745ed2f559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51811b3-703d-4a73-a544-7a745ed2f559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a1900e-91b3-459f-8be7-a9eaeaaa7b7f', 'volume_name': 'volume-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc577b3d-9f14-4344-a8fc-d39da5e54de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc577b3d-9f14-4344-a8fc-d39da5e54de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65440fcc-a192-4885-a58a-34d95fbeff28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:23 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume 76a1900e-91b3-459f-8be7-a9eaeaaa7b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f', 'volume_size': 1} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] <== create_volume: return (1794ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.102s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] Creating offline snapshot 41a4edf3-ead3-4a48-8460-27f5d07a8894 of volume 6bff0236-8119-4612-b0d2-1b04bc60c06b {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a33c45-8068-4e4b-8c98-7dfd594d9c77]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279add7e-c683-4d1d-939a-0bb079902c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95d84f28-f935-472e-a13a-2bcb8d465e99', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a84d72e-9739-4299-9ad1-4883dd880681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:24 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Flow 'volume_create_manager' (846ee207-6b39-48bf-95b1-7141d679034f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2438098-3a52-4df5-8f9f-72d43cd8b6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:24 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Flow 'volume_create_manager' (21024e57-0e7b-4fda-b668-7db2198c6251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2735d4-c8d5-42cf-add5-81d938c00bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:24 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Flow 'volume_create_manager' (3e9e5eac-43fa-4638-b8d4-03f014902cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa406c1-f738-427f-a5b8-e89f067f972f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2438098-3a52-4df5-8f9f-72d43cd8b6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1531392833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee282db3-f8c1-4f2f-84c9-18024a92c7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef6caa38dd64fdba1174f957d9b3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:23Z,use_quota=True,user_id='20e49a6052df40a9b6dd0426d0a9e075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106ca62d-c1ee-4e50-ba75-08eb2cb576ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106ca62d-c1ee-4e50-ba75-08eb2cb576ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53658ddc-b7f3-4df7-81a4-dbf6fbb9ae32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53658ddc-b7f3-4df7-81a4-dbf6fbb9ae32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee282db3-f8c1-4f2f-84c9-18024a92c7fc', 'volume_name': 'volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f403857b-83f2-46fb-8618-5204d0e7e2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f403857b-83f2-46fb-8618-5204d0e7e2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627027ce-1020-4d93-b687-9435a5bdf518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:24 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Volume ee282db3-f8c1-4f2f-84c9-18024a92c7fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc', 'volume_size': 1} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:24 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume volume-95d84f28-f935-472e-a13a-2bcb8d465e99 (95d84f28-f935-472e-a13a-2bcb8d465e99): created successfully Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a84d72e-9739-4299-9ad1-4883dd880681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Flow 'volume_create_manager' (1a42b9a4-f094-4042-a430-e8568c7720ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b" returned: 0 in 0.753s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2735d4-c8d5-42cf-add5-81d938c00bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2109897420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4428e733-f620-42f9-a00c-b4700648950b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc5f61e96ba4996ba876012509418bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:23Z,use_quota=True,user_id='8fbf88dfa38c483384c95935a57a2983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101822ac-5c36-4bdf-ba80-365a6bf8975a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:24 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=158, name=volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:24 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101822ac-5c36-4bdf-ba80-365a6bf8975a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3f0aad-9501-46a4-bb82-637b50f88457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3f0aad-9501-46a4-bb82-637b50f88457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4428e733-f620-42f9-a00c-b4700648950b', 'volume_name': 'volume-4428e733-f620-42f9-a00c-b4700648950b', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb5bba1-317b-4a95-be32-0501a105744e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feb5bba1-317b-4a95-be32-0501a105744e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d0d0a8-fe62-4ed4-818e-21f22f1e246c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:25 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume 4428e733-f620-42f9-a00c-b4700648950b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4428e733-f620-42f9-a00c-b4700648950b', 'volume_size': 1} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:25 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5636cbde-b63f-4641-aca5-17a37a975f16 tempest-CreateVolumesFromSnapshotTest-902284424 None] Created volume successfully. Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa406c1-f738-427f-a5b8-e89f067f972f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754007360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c8094a-d196-4985-bf56-79b969387646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc5f61e96ba4996ba876012509418bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:24Z,use_quota=True,user_id='8fbf88dfa38c483384c95935a57a2983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f481f14b-15e3-4fe3-848d-dce04aa66c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f481f14b-15e3-4fe3-848d-dce04aa66c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22623bb7-9bb8-4cd6-bc1b-a8fba9dc621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22623bb7-9bb8-4cd6-bc1b-a8fba9dc621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c8094a-d196-4985-bf56-79b969387646', 'volume_name': 'volume-e1c8094a-d196-4985-bf56-79b969387646', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7741b117-1760-47fa-9440-12f003ce0bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7741b117-1760-47fa-9440-12f003ce0bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c888f0c4-30dc-4bbf-b7a2-ec99b9e0bc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:25 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume e1c8094a-d196-4985-bf56-79b969387646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c8094a-d196-4985-bf56-79b969387646', 'volume_size': 1} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894 1G" returned: 0 in 0.539s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6bff0236-8119-4612-b0d2-1b04bc60c06b -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:25 devstack quobyte-client[83219]: System call of process 102141 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] CMD "qemu-img rebase -u -b volume-6bff0236-8119-4612-b0d2-1b04bc60c06b -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894" returned: 0 in 0.171s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894 is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894" returned: 0 in 0.094s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894" returned: 0 in 0.084s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.info" returned: 0 in 0.085s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.info" returned: 0 in 0.090s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.092s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.262s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-22190957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66551225-43cf-4b15-99b2-1668a2398a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc5f61e96ba4996ba876012509418bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:22Z,use_quota=True,user_id='8fbf88dfa38c483384c95935a57a2983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Creating volume 66551225-43cf-4b15-99b2-1668a2398a8e {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:08:26 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66551225-43cf-4b15-99b2-1668a2398a8e 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:26 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=160, name=volume-66551225-43cf-4b15-99b2-1668a2398a8e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:26 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-0720be2f-4ec9-4d37-a60d-b128fdf11262 tempest-SnapshotDependencyTests-1838244486 None] Create snapshot completed successfully Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66551225-43cf-4b15-99b2-1668a2398a8e 1073741824" returned: 0 in 0.453s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66551225-43cf-4b15-99b2-1668a2398a8e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66551225-43cf-4b15-99b2-1668a2398a8e" returned: 0 in 0.155s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] <== create_volume: return (655ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.991s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611609893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a1900e-91b3-459f-8be7-a9eaeaaa7b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc5f61e96ba4996ba876012509418bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:23Z,use_quota=True,user_id='8fbf88dfa38c483384c95935a57a2983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Creating volume 76a1900e-91b3-459f-8be7-a9eaeaaa7b7f {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:08:26 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:08:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:27 devstack quobyte-client[83219]: System call of process 102152 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:27 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=161, name=volume-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77340ac6-29a5-4170-b4f1-eace1030ea7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66551225-43cf-4b15-99b2-1668a2398a8e', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367c2b89-c47d-4714-a9b4-f6851e527880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f 1073741824" returned: 0 in 0.425s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:27 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume volume-66551225-43cf-4b15-99b2-1668a2398a8e (66551225-43cf-4b15-99b2-1668a2398a8e): created successfully Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367c2b89-c47d-4714-a9b4-f6851e527880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Flow 'volume_create_manager' (d1f1ab9a-f3f7-4684-93c6-a2bff6f73aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f" returned: 0 in 0.311s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] <== create_volume: return (763ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.985s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1531392833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee282db3-f8c1-4f2f-84c9-18024a92c7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef6caa38dd64fdba1174f957d9b3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:23Z,use_quota=True,user_id='20e49a6052df40a9b6dd0426d0a9e075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Creating volume ee282db3-f8c1-4f2f-84c9-18024a92c7fc {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:08:27 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:08:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:27 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-49565e6c-0d78-47dd-a3dc-6e8a9a8fd288 tempest-CreateVolumesFromSnapshotTest-902284424 None] Created volume successfully. Sep 17 08:08:27 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=162, name=volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65440fcc-a192-4885-a58a-34d95fbeff28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9afeb7b-fd62-412f-aafc-355deaff9dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:28 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume volume-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f (76a1900e-91b3-459f-8be7-a9eaeaaa7b7f): created successfully Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9afeb7b-fd62-412f-aafc-355deaff9dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Flow 'volume_create_manager' (ab7a2edc-82a2-44f9-b0ea-51d7679a047c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc 1073741824" returned: 0 in 0.996s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.725s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:08:28 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:08:29 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-a9762e42-ff44-4697-bd7d-738828d41872 tempest-CreateVolumesFromSnapshotTest-902284424 None] Created volume successfully. Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc" returned: 0 in 0.388s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] <== create_volume: return (1419ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.077s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2109897420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4428e733-f620-42f9-a00c-b4700648950b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc5f61e96ba4996ba876012509418bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:23Z,use_quota=True,user_id='8fbf88dfa38c483384c95935a57a2983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Creating volume 4428e733-f620-42f9-a00c-b4700648950b {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:08:29 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4428e733-f620-42f9-a00c-b4700648950b 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=86,cinder:SELECT=58,cinder:DELETE=12,cinder:INSERT=14 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:08:29 devstack quobyte-client[83219]: System call of process 102161 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:29 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=163, name=volume-4428e733-f620-42f9-a00c-b4700648950b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627027ce-1020-4d93-b687-9435a5bdf518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb6f14d-d299-477b-a6b2-a342b66aad59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Flow 'volume_create_manager' (c21dc810-1064-46bf-a97f-562ceb7623e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4e63c6-b454-452f-bc06-25a228c35c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=51,cinder:UPDATE=72,cinder:DELETE=8,cinder:INSERT=19 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4428e733-f620-42f9-a00c-b4700648950b 1073741824" returned: 0 in 0.591s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4428e733-f620-42f9-a00c-b4700648950b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:29 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Volume volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc (ee282db3-f8c1-4f2f-84c9-18024a92c7fc): created successfully Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb6f14d-d299-477b-a6b2-a342b66aad59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:29 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Flow 'volume_create_manager' (846ee207-6b39-48bf-95b1-7141d679034f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4e63c6-b454-452f-bc06-25a228c35c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb095cd4-a176-4798-aa66-ffd6ed7a457f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f6c0c027f64ca3a4afb23f8be973ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41a4edf3-ead3-4a48-8460-27f5d07a8894,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:28Z,use_quota=True,user_id='1713b32082ea49788a850dc761ba8b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9846df90-76b4-4725-a97a-8cce70595ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9846df90-76b4-4725-a97a-8cce70595ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4b71c5-d790-420e-b096-dec5dd3f12d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4b71c5-d790-420e-b096-dec5dd3f12d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb095cd4-a176-4798-aa66-ffd6ed7a457f', 'volume_name': 'volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f', 'volume_size': 1, 'snapshot_id': '41a4edf3-ead3-4a48-8460-27f5d07a8894'}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4f8c6d-9998-41a5-bffb-414f56e36833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4f8c6d-9998-41a5-bffb-414f56e36833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692fe730-d4f5-46a4-bc05-b218bdcdf20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:30 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Volume fb095cd4-a176-4798-aa66-ffd6ed7a457f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f', 'volume_size': 1, 'snapshot_id': '41a4edf3-ead3-4a48-8460-27f5d07a8894'} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:30 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5929ec78-a3da-4929-8a82-edb7b689a8d5 tempest-CinderUnicodeTest-726850965 None] Created volume successfully. Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4428e733-f620-42f9-a00c-b4700648950b" returned: 0 in 0.461s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] <== create_volume: return (1072ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.970s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754007360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c8094a-d196-4985-bf56-79b969387646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc5f61e96ba4996ba876012509418bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:08:24Z,use_quota=True,user_id='8fbf88dfa38c483384c95935a57a2983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Creating volume e1c8094a-d196-4985-bf56-79b969387646 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:08:30 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e1c8094a-d196-4985-bf56-79b969387646 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:30 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=164, name=volume-e1c8094a-d196-4985-bf56-79b969387646, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d0d0a8-fe62-4ed4-818e-21f22f1e246c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4428e733-f620-42f9-a00c-b4700648950b', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fab02cd-37a1-4bcc-a2f7-55d760af8c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e1c8094a-d196-4985-bf56-79b969387646 1073741824" returned: 0 in 0.401s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e1c8094a-d196-4985-bf56-79b969387646 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:30 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume volume-4428e733-f620-42f9-a00c-b4700648950b (4428e733-f620-42f9-a00c-b4700648950b): created successfully Sep 17 08:08:30 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fab02cd-37a1-4bcc-a2f7-55d760af8c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Flow 'volume_create_manager' (21024e57-0e7b-4fda-b668-7db2198c6251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e1c8094a-d196-4985-bf56-79b969387646" returned: 0 in 0.458s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] <== create_volume: return (881ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.934s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "cinder-quobyte-41a4edf3-ead3-4a48-8460-27f5d07a8894-fb095cd4-a176-4798-aa66-ffd6ed7a457f" by "_create_volume_from_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:31 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-09fdbce9-0e25-46e1-a916-6bd9dfce7972 tempest-CreateVolumesFromSnapshotTest-902284424 None] Created volume successfully. Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-quobyte-41a4edf3-ead3-4a48-8460-27f5d07a8894-fb095cd4-a176-4798-aa66-ffd6ed7a457f" acquired by "_create_volume_from_snapshot" :: waited 0.172s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Creating volume fb095cd4-a176-4798-aa66-ffd6ed7a457f from snapshot 41a4edf3-ead3-4a48-8460-27f5d07a8894 {{(pid=83207) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "cinder-quobyte-fb095cd4-a176-4798-aa66-ffd6ed7a457f" by "_copy_volume_from_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c888f0c4-30dc-4bbf-b7a2-ec99b9e0bc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c8094a-d196-4985-bf56-79b969387646', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6a96f5-c083-4911-8b9c-f440e47c4d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:31 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-quobyte-fb095cd4-a176-4798-aa66-ffd6ed7a457f" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] snapshot: 41a4edf3-ead3-4a48-8460-27f5d07a8894, volume: fb095cd4-a176-4798-aa66-ffd6ed7a457f, {{(pid=83207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 17 08:08:31 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume volume-e1c8094a-d196-4985-bf56-79b969387646 (e1c8094a-d196-4985-bf56-79b969387646): created successfully Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6a96f5-c083-4911-8b9c-f440e47c4d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Flow 'volume_create_manager' (3e9e5eac-43fa-4638-b8d4-03f014902cd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:31 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-1be2676a-c109-4b11-b257-f15f4ea793b0 tempest-CreateVolumesFromSnapshotTest-902284424 None] Created volume successfully. Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[083bcfd9-5173-4215-9b71-a7e411e3f2d4]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894" returned: 0 in 0.435s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:31 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bff0236-8119-4612-b0d2-1b04bc60c06b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 08:08:32 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] will copy from snapshot at /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b {{(pid=83207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 17 08:08:32 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Creating direct copy from snapshot {{(pid=83207) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 17 08:08:32 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f51f76c-0a43-4d94-afb3-194417141759]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-e1c8094a-d196-4985-bf56-79b969387646-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-e1c8094a-d196-4985-bf56-79b969387646-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:32 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-quobyte-e1c8094a-d196-4985-bf56-79b969387646" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b" returned: 0 in 0.619s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:32 devstack cinder-volume[83207]: DEBUG cinder.utils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f not found in is_blk_device check {{(pid=83207) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 17 08:08:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:32 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=165, name=volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-e1c8094a-d196-4985-bf56-79b969387646" acquired by "delete_volume" :: waited 0.254s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:33 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[7896753b-795e-4baa-a5bf-dda468f08d9f]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:33 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e1c8094a-d196-4985-bf56-79b969387646 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:34 devstack quobyte-client[83219]: System call of process 102179 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e1c8094a-d196-4985-bf56-79b969387646" returned: 0 in 1.433s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:34 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e1c8094a-d196-4985-bf56-79b969387646 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:35 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-e1c8094a-d196-4985-bf56-79b969387646" returned: 0 in 0.424s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:35 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-e1c8094a-d196-4985-bf56-79b969387646" released by "delete_volume" :: held 2.321s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:36 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Created reservations ['dd73c94a-e406-40a0-88fc-ece58dd45015', '60180ec1-4906-4c22-abef-5c671c8cce31', 'f886a78a-b1b4-4310-ab49-a60d2166deaf', 'e132dec3-f7db-4cc3-b3fd-717a35fc551e'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:08:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:36 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.137s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:36 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:37 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.330s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:37 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:08:37 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Deleted volume successfully. Sep 17 08:08:38 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-4428e733-f620-42f9-a00c-b4700648950b-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:39 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e82d277f-b982-492c-96e7-43f0b5448892 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-e1c8094a-d196-4985-bf56-79b969387646-delete_volume" released by "delete_volume" :: held 7.095s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:39 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-4428e733-f620-42f9-a00c-b4700648950b-delete_volume" acquired by "delete_volume" :: waited 0.994s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f" returned: 0 in 6.884s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:39 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d995bf4-a081-4f0b-8c0d-b9fcc1ffc8c8]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:39 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:40 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-quobyte-4428e733-f620-42f9-a00c-b4700648950b" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-4428e733-f620-42f9-a00c-b4700648950b" acquired by "delete_volume" :: waited 0.067s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9bf402-62fe-40e4-9443-c35bcd7763c6]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4428e733-f620-42f9-a00c-b4700648950b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b" returned: 0 in 0.817s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG cinder.image.image_utils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Image conversion details: src /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b, size 1024.00 MB, duration 6.89 sec, destination /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f {{(pid=83207) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 17 08:08:40 devstack cinder-volume[83207]: INFO cinder.image.image_utils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Converted 1024.00 MB image at 148.66 MB/s Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f" returned: 0 in 0.105s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4428e733-f620-42f9-a00c-b4700648950b" returned: 0 in 0.570s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4428e733-f620-42f9-a00c-b4700648950b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-quobyte-fb095cd4-a176-4798-aa66-ffd6ed7a457f" released by "_copy_volume_from_snapshot" :: held 9.390s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-4428e733-f620-42f9-a00c-b4700648950b" returned: 0 in 0.197s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-quobyte-41a4edf3-ead3-4a48-8460-27f5d07a8894-fb095cd4-a176-4798-aa66-ffd6ed7a457f" released by "_create_volume_from_snapshot" :: held 9.571s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:40 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.758s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.617s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:41 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] Creating offline snapshot 87ad6144-41aa-432d-9962-dd4e73f8a39c of volume ee282db3-f8c1-4f2f-84c9-18024a92c7fc {{(pid=83207) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 17 08:08:41 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[60abb7b6-6980-43c0-9ab8-de1ab9695492]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:41 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-4428e733-f620-42f9-a00c-b4700648950b" released by "delete_volume" :: held 1.096s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (692fe730-d4f5-46a4-bc05-b218bdcdf20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f', 'volume_size': 1, 'snapshot_id': '41a4edf3-ead3-4a48-8460-27f5d07a8894'}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b762b6-b97b-488d-a0f9-958a74cf5ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:08:41 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Volume volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f (fb095cd4-a176-4798-aa66-ffd6ed7a457f): created successfully Sep 17 08:08:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b762b6-b97b-488d-a0f9-958a74cf5ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:08:41 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Flow 'volume_create_manager' (c21dc810-1064-46bf-a97f-562ceb7623e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:08:41 devstack quobyte-client[83219]: System call of process 102236 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:41 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-e089260d-bb80-4e15-8d60-f4d129b50410 tempest-SnapshotDependencyTests-1838244486 None] Created volume successfully. Sep 17 08:08:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc" returned: 0 in 0.630s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:41 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c 1G {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:42 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=166, name=volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:08:42 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Created reservations ['36a17746-de7d-4590-9aa7-7e0f10f21e34', '8d7a3f0b-c188-4700-aa85-c7ee6a7cb660', 'ea95339c-7c72-49d7-a71a-91cd8265c929', '7db9633a-8f0a-4f9d-81df-f35f41fba92a'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:08:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c 1G" returned: 0 in 0.419s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] CMD "qemu-img rebase -u -b volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc -F qcow2 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c" returned: 0 in 0.315s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:42 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 08:08:42 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:42 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "cinder-41a4edf3-ead3-4a48-8460-27f5d07a8894-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c" returned: 0 in 0.437s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] Setting permissions: /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc -> 1000:1000 {{(pid=83207) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f-delete_volume" acquired by "delete_volume" :: waited 0.525s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-41a4edf3-ead3-4a48-8460-27f5d07a8894-delete_snapshot" acquired by "delete_snapshot" :: waited 0.387s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:43 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "cinder-quobyte-6bff0236-8119-4612-b0d2-1b04bc60c06b" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c" returned: 0 in 0.389s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:43 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-quobyte-6bff0236-8119-4612-b0d2-1b04bc60c06b" acquired by "delete_snapshot" :: waited 0.597s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "cinder-quobyte-41a4edf3-ead3-4a48-8460-27f5d07a8894" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.info" returned: 0 in 0.610s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] File path /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.info is being set with permissions: 660 {{(pid=83207) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.info {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.627s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:08:44 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Deleted volume successfully. Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-quobyte-41a4edf3-ead3-4a48-8460-27f5d07a8894" acquired by "_delete_snapshot" :: waited 0.462s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Deleting offline snapshot 41a4edf3-ead3-4a48-8460-27f5d07a8894 of volume 6bff0236-8119-4612-b0d2-1b04bc60c06b {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] snapshot_file for this snap is: volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 08:08:44 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-quobyte-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21a06ca-1c8f-4c74-a0d3-3f9b94fa1e28]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.info" returned: 0 in 0.586s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:44 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.917s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:45 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f" acquired by "delete_volume" :: waited 0.566s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:45 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d7b2a679-5201-48a9-baa8-f73ea4b5af27 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-4428e733-f620-42f9-a00c-b4700648950b-delete_volume" released by "delete_volume" :: held 5.692s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:45 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-47c17222-ceed-48aa-8ea6-f0f67e76bb45 tempest-CinderUnicodeTest-726850965 None] Create snapshot completed successfully Sep 17 08:08:45 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5da7892-1cfa-4b33-908d-fd133ba086e9]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894" returned: 0 in 0.755s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:45 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bff0236-8119-4612-b0d2-1b04bc60c06b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 08:08:45 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[75904b98-dd16-4f0e-a52c-8a9ecf3846c1]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:45 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:45 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Acquiring lock "cinder-87ad6144-41aa-432d-9962-dd4e73f8a39c-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f" returned: 0 in 0.808s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Lock "cinder-87ad6144-41aa-432d-9962-dd4e73f8a39c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.122s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:46 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Acquiring lock "cinder-quobyte-ee282db3-f8c1-4f2f-84c9-18024a92c7fc" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b" returned: 0 in 0.798s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Lock "cinder-quobyte-ee282db3-f8c1-4f2f-84c9-18024a92c7fc" acquired by "delete_snapshot" :: waited 0.368s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Acquiring lock "cinder-quobyte-87ad6144-41aa-432d-9962-dd4e73f8a39c" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f" returned: 0 in 0.452s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f" released by "delete_volume" :: held 1.446s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894" returned: 0 in 0.416s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Lock "cinder-quobyte-87ad6144-41aa-432d-9962-dd4e73f8a39c" acquired by "_delete_snapshot" :: waited 0.259s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Deleting offline snapshot 87ad6144-41aa-432d-9962-dd4e73f8a39c of volume ee282db3-f8c1-4f2f-84c9-18024a92c7fc {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] snapshot_file for this snap is: volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:46 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49c3367-c976-43c4-86ef-b241279ff947]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b.41a4edf3-ead3-4a48-8460-27f5d07a8894" returned: 0 in 0.566s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-quobyte-41a4edf3-ead3-4a48-8460-27f5d07a8894" released by "_delete_snapshot" :: held 2.893s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:47 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-quobyte-6bff0236-8119-4612-b0d2-1b04bc60c06b" released by "delete_snapshot" :: held 3.461s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:47 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Created reservations ['f3fd703e-dd3e-4ed5-86ae-d21823561810', '47e12fab-9ec6-4c0a-b3bb-ec49f655a481', '6d8545ca-de40-4ae5-bb41-ded360f7c015', 'bd36ecd8-1231-448c-a404-fa5ae5ab90ce'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:08:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c" returned: 0 in 0.653s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:47 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 08:08:47 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[76088428-af19-48b5-9e4e-a9d582d7cead]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:47 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.039s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:48 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-66551225-43cf-4b15-99b2-1668a2398a8e-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc" returned: 0 in 0.911s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:48 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.502s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:48 devstack quobyte-client[83219]: System call of process 102278 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:48 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-66551225-43cf-4b15-99b2-1668a2398a8e-delete_volume" acquired by "delete_volume" :: waited 0.369s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:49 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:08:49 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Created reservations ['965f9c23-2696-4385-855d-2756cd75368d', '9c15523f-1d8b-43e2-ad2c-00c96e19b23f', '47414d8b-82c6-4fd3-9fd4-3c406b104343', '0d3efd34-2610-44d3-9196-a38ce8b3ff63'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:08:49 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Deleted volume successfully. Sep 17 08:08:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c" returned: 0 in 0.488s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:49 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-quobyte-66551225-43cf-4b15-99b2-1668a2398a8e" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-66551225-43cf-4b15-99b2-1668a2398a8e" acquired by "delete_volume" :: waited 0.052s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:49 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dadb81-a451-4e60-91b5-2a3801bb4d39]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:49 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-1070bae6-0f12-4735-9bb2-a006469bade8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-76a1900e-91b3-459f-8be7-a9eaeaaa7b7f-delete_volume" released by "delete_volume" :: held 6.315s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc.87ad6144-41aa-432d-9962-dd4e73f8a39c" returned: 0 in 0.548s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:49 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66551225-43cf-4b15-99b2-1668a2398a8e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Lock "cinder-quobyte-87ad6144-41aa-432d-9962-dd4e73f8a39c" released by "_delete_snapshot" :: held 3.334s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Lock "cinder-quobyte-ee282db3-f8c1-4f2f-84c9-18024a92c7fc" released by "delete_snapshot" :: held 3.679s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:50 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Delete snapshot completed successfully. Sep 17 08:08:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-91afa8db-372a-4f2f-a9d2-99732e369de3 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-41a4edf3-ead3-4a48-8460-27f5d07a8894-delete_snapshot" released by "delete_snapshot" :: held 6.824s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66551225-43cf-4b15-99b2-1668a2398a8e" returned: 0 in 0.649s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66551225-43cf-4b15-99b2-1668a2398a8e {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "cinder-6bff0236-8119-4612-b0d2-1b04bc60c06b-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:50 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-66551225-43cf-4b15-99b2-1668a2398a8e" returned: 0 in 0.394s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-6bff0236-8119-4612-b0d2-1b04bc60c06b-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:50 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-66551225-43cf-4b15-99b2-1668a2398a8e" released by "delete_volume" :: held 1.214s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:50 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Created reservations ['4f7d55d7-4419-487f-a5f8-277f9242013a', 'b3ea9ee3-57c8-41e4-99ee-79e0e9ec370d', '48c57e94-195b-424a-a7e6-548ad804fd0f', '25bd928f-c3d5-4545-a976-92c8e31eb1e3'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Created reservations ['634b7187-1744-4772-8956-4429cac39ca3', 'b3df0084-ff17-47d4-95cb-e9a24b6636b9', '47cb66bd-07f3-4414-9678-1aed37b524cb', 'bf4983f3-0fac-4934-a9f6-05b39795db06'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:08:51 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "cinder-quobyte-6bff0236-8119-4612-b0d2-1b04bc60c06b" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-quobyte-6bff0236-8119-4612-b0d2-1b04bc60c06b" acquired by "delete_volume" :: waited 0.035s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[596ce53e-5e1c-464a-9479-4b4931d5e67a]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Acquiring lock "cinder-ee282db3-f8c1-4f2f-84c9-18024a92c7fc-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Lock "cinder-ee282db3-f8c1-4f2f-84c9-18024a92c7fc-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:51 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Delete snapshot completed successfully. Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a039955b-cac7-4d1c-ac32-a51b9c436c30 tempest-CinderUnicodeTest-726850965 None] Lock "cinder-87ad6144-41aa-432d-9962-dd4e73f8a39c-delete_snapshot" released by "delete_snapshot" :: held 5.605s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:51 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Acquiring lock "cinder-quobyte-ee282db3-f8c1-4f2f-84c9-18024a92c7fc" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:51 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-95d84f28-f935-472e-a13a-2bcb8d465e99-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b" returned: 0 in 0.990s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Lock "cinder-quobyte-ee282db3-f8c1-4f2f-84c9-18024a92c7fc" acquired by "delete_volume" :: waited 0.445s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:52 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a2c2dc-837e-4d40-bba4-b7fd82eb8162]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.696s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:52 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:08:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-6bff0236-8119-4612-b0d2-1b04bc60c06b" returned: 0 in 0.533s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-95d84f28-f935-472e-a13a-2bcb8d465e99-delete_volume" acquired by "delete_volume" :: waited 0.611s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:52 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Deleted volume successfully. Sep 17 08:08:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-quobyte-6bff0236-8119-4612-b0d2-1b04bc60c06b" released by "delete_volume" :: held 1.819s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:52 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b0fea5ee-cafa-4241-bf26-2258cc2e7318 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-66551225-43cf-4b15-99b2-1668a2398a8e-delete_volume" released by "delete_volume" :: held 4.042s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc" returned: 0 in 0.607s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:52 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-ee282db3-f8c1-4f2f-84c9-18024a92c7fc" returned: 0 in 0.359s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:53 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-quobyte-95d84f28-f935-472e-a13a-2bcb8d465e99" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Lock "cinder-quobyte-ee282db3-f8c1-4f2f-84c9-18024a92c7fc" released by "delete_volume" :: held 1.217s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:53 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-95d84f28-f935-472e-a13a-2bcb8d465e99" acquired by "delete_volume" :: waited 0.119s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:53 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[948963cb-c901-4bf4-bbf4-47a2837251cf]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:53 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-95d84f28-f935-472e-a13a-2bcb8d465e99 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:53 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Created reservations ['7317cfac-b1fe-490d-a722-e91fcd265f1b', 'd4b2230b-2074-414d-9b80-9f7e19482f6b', '9c3c10c1-d533-4938-9e48-5def3993aaa9', 'cc207bf9-7206-490d-9402-1c97dc7a6ff2'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:08:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-95d84f28-f935-472e-a13a-2bcb8d465e99" returned: 0 in 0.609s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-95d84f28-f935-472e-a13a-2bcb8d465e99 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:54 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Created reservations ['210f55c2-beca-4743-8996-d73ff09774c9', '8b29825f-467e-45b5-be04-b6ee9dca7882', '1d251d42-3f0d-435f-9154-c1d4d5dcb6cd', '2cea99ad-c894-4620-9fd7-64c1100b5c47'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:08:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-95d84f28-f935-472e-a13a-2bcb8d465e99" returned: 0 in 0.315s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:54 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-95d84f28-f935-472e-a13a-2bcb8d465e99" released by "delete_volume" :: held 1.100s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:54 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:54 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:55 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Created reservations ['ffc34c1c-6785-4f43-b619-599771b2dbb1', '0743e1f2-97d3-47b9-b5a7-ac1e89bd696f', '5aa43b7f-df76-4f5e-9656-dcb227183469', '607c6080-d4ac-4256-b508-fdda63a56c4d'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:08:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "cinder-fb095cd4-a176-4798-aa66-ffd6ed7a457f-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.546s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:55 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:08:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-fb095cd4-a176-4798-aa66-ffd6ed7a457f-delete_volume" acquired by "delete_volume" :: waited 0.180s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:55 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Deleted volume successfully. Sep 17 08:08:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-6be728e7-429a-4cba-bace-25705a720be0 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-6bff0236-8119-4612-b0d2-1b04bc60c06b-delete_volume" released by "delete_volume" :: held 4.650s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:55 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:55 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:55 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Acquiring lock "cinder-619690fa-61a8-42d9-93a2-d192c5302495-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:55 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.494s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:56 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "cinder-quobyte-fb095cd4-a176-4798-aa66-ffd6ed7a457f" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:56 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:08:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Lock "cinder-619690fa-61a8-42d9-93a2-d192c5302495-delete_volume" acquired by "delete_volume" :: waited 0.173s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:56 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Deleted volume successfully. Sep 17 08:08:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:56 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-quobyte-fb095cd4-a176-4798-aa66-ffd6ed7a457f" acquired by "delete_volume" :: waited 0.300s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:56 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[e187703e-b15a-4258-9f02-921ff4b1fcf2]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-a6c271ec-bf78-4bef-90b8-8c255aa0814b-delete_snapshot" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:56 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:56 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-38180560-17e1-4341-888d-b3f9dff5b36d tempest-CinderUnicodeTest-726850965 None] Lock "cinder-ee282db3-f8c1-4f2f-84c9-18024a92c7fc-delete_volume" released by "delete_volume" :: held 5.171s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:56 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Acquiring lock "cinder-quobyte-619690fa-61a8-42d9-93a2-d192c5302495" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.931s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-a6c271ec-bf78-4bef-90b8-8c255aa0814b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.552s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:57 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-quobyte-5281d188-24a5-436e-b5a8-8f66836ca336" by "delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:57 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Deleted volume successfully. Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Lock "cinder-quobyte-619690fa-61a8-42d9-93a2-d192c5302495" acquired by "delete_volume" :: waited 0.211s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f" returned: 0 in 0.640s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7dafae-cac4-4e25-929d-63315d09c024]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-5281d188-24a5-436e-b5a8-8f66836ca336" acquired by "delete_snapshot" :: waited 0.324s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-quobyte-a6c271ec-bf78-4bef-90b8-8c255aa0814b" by "_delete_snapshot" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-619690fa-61a8-42d9-93a2-d192c5302495 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-11629fdf-0d85-4535-9a60-2f1f23ab731c tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-95d84f28-f935-472e-a13a-2bcb8d465e99-delete_volume" released by "delete_volume" :: held 5.042s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-fb095cd4-a176-4798-aa66-ffd6ed7a457f" returned: 0 in 0.554s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-a6c271ec-bf78-4bef-90b8-8c255aa0814b" acquired by "_delete_snapshot" :: waited 0.336s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Deleting offline snapshot a6c271ec-bf78-4bef-90b8-8c255aa0814b of volume 5281d188-24a5-436e-b5a8-8f66836ca336 {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] snapshot_file for this snap is: volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b {{(pid=83207) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cedcf7-c0f9-4d76-8b3c-e1d0b64e084d]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:57 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-quobyte-fb095cd4-a176-4798-aa66-ffd6ed7a457f" released by "delete_volume" :: held 1.731s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-619690fa-61a8-42d9-93a2-d192c5302495" returned: 0 in 0.742s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-619690fa-61a8-42d9-93a2-d192c5302495 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:58 devstack quobyte-client[83219]: System call of process 102308 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b" returned: 0 in 0.774s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-619690fa-61a8-42d9-93a2-d192c5302495" returned: 0 in 0.357s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:58 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5281d188-24a5-436e-b5a8-8f66836ca336(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83207) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 17 08:08:58 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1c2f01-b5c7-47df-b122-4545be321d27]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:08:58 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:58 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Lock "cinder-quobyte-619690fa-61a8-42d9-93a2-d192c5302495" released by "delete_volume" :: held 1.728s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:08:59 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Created reservations ['0db9d0d8-4dd0-4571-8062-9b628cecbb7a', '9b953675-3594-47ce-bfcf-7a54504b8aa7', '9eedde5c-8f3e-47e7-a9e4-635992d04b20', 'db12404e-df6b-4511-9ff9-086bb37752f8'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:08:59 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Created reservations ['e5c314af-c90b-4254-8328-64f43ac61951', '4c48dd3d-1f39-45be-b4c8-154c64f8d483', '4495535e-0578-4736-9def-adc217bac6b3', '81e960b9-4053-48b6-9ad9-217f9833016d'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:08:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336" returned: 0 in 0.625s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:08:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:08:59 devstack quobyte-client[83219]: System call of process 102317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:08:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:08:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:08:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:08:59 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:08:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:08:59 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b" returned: 0 in 0.614s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.451s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:00 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:09:00 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Deleted volume successfully. Sep 17 08:09:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336.a6c271ec-bf78-4bef-90b8-8c255aa0814b" returned: 0 in 0.407s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:00 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:00 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:00 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-a6c271ec-bf78-4bef-90b8-8c255aa0814b" released by "_delete_snapshot" :: held 2.924s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-51b53ae2-51cf-4306-8486-6e688ec74a05 tempest-SnapshotDependencyTests-1838244486 None] Lock "cinder-fb095cd4-a176-4798-aa66-ffd6ed7a457f-delete_volume" released by "delete_volume" :: held 5.477s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:00 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-5281d188-24a5-436e-b5a8-8f66836ca336" released by "delete_snapshot" :: held 3.494s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:01 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.517s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:01 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:09:01 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Deleted volume successfully. Sep 17 08:09:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-b550ed25-2a66-4623-a231-2ffb7c71ff3c tempest-CinderUnicodeTest-726850965 None] Lock "cinder-619690fa-61a8-42d9-93a2-d192c5302495-delete_volume" released by "delete_volume" :: held 5.291s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:01 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Created reservations ['33abbe0a-d774-4d46-95ac-4b0925e0ee05', '5a5e176c-3866-46e6-af88-71a2043c448f', '105931ab-6ac3-4f58-9ae4-7a3f382b4877', 'd032df69-7956-426e-9ac0-c72f6a1333e1'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:09:01 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Delete snapshot completed successfully. Sep 17 08:09:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-8ca2cad1-fda1-4139-803c-331ea37edbeb tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-a6c271ec-bf78-4bef-90b8-8c255aa0814b-delete_snapshot" released by "delete_snapshot" :: held 4.489s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:01 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-5281d188-24a5-436e-b5a8-8f66836ca336-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:09:02 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-5281d188-24a5-436e-b5a8-8f66836ca336-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:09:02 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:09:02 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "cinder-quobyte-5281d188-24a5-436e-b5a8-8f66836ca336" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:09:02 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-5281d188-24a5-436e-b5a8-8f66836ca336" acquired by "delete_volume" :: waited 0.011s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:09:02 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[b286401d-dafd-435e-83ce-2b176080acc4]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:09:02 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:02 devstack quobyte-client[83219]: System call of process 102326 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:09:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336" returned: 0 in 0.793s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-5281d188-24a5-436e-b5a8-8f66836ca336" returned: 0 in 0.166s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:03 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-quobyte-5281d188-24a5-436e-b5a8-8f66836ca336" released by "delete_volume" :: held 1.323s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:03 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Created reservations ['e543e857-1e65-415b-aedf-bf13bfb1f83b', '9bf584bf-65e9-4a27-903a-e6dc28eac869', 'c085e842-8ab2-48b4-a822-fc7225223f1a', 'b1d6698f-ba2d-423b-a2e7-fce9acb4efd1'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:09:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:03 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:03 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:04 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.117s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:04 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:09:04 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Deleted volume successfully. Sep 17 08:09:04 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-46f4ead4-fb93-4af0-a045-33d2483522f8 tempest-CreateVolumesFromSnapshotTest-902284424 None] Lock "cinder-5281d188-24a5-436e-b5a8-8f66836ca336-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:08 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:09:08 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Flow 'volume_create_manager' (1515cca1-3984-4d3d-a4a1-7937674760cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd3c4b5-d51a-4d5c-acf4-c11551036e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd3c4b5-d51a-4d5c-acf4-c11551036e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-899773920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44019aa-899c-4d98-9021-749541e4bfe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce79f2125f64f3f9130b4782a255391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:09:09Z,use_quota=True,user_id='3157aae11a5046969ee882cf2ad1124c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd218773-a2fd-40ea-8482-f433f27041a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd218773-a2fd-40ea-8482-f433f27041a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac8c092-383f-4bec-a9d0-57bdf36649d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac8c092-383f-4bec-a9d0-57bdf36649d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44019aa-899c-4d98-9021-749541e4bfe0', 'volume_name': 'volume-a44019aa-899c-4d98-9021-749541e4bfe0', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80efd0e2-0ecc-4ac9-a185-466da7127586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80efd0e2-0ecc-4ac9-a185-466da7127586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57feecae-a1bc-49fa-91f9-dab8886eae64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:09 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume a44019aa-899c-4d98-9021-749541e4bfe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44019aa-899c-4d98-9021-749541e4bfe0', 'volume_size': 1} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-899773920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44019aa-899c-4d98-9021-749541e4bfe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce79f2125f64f3f9130b4782a255391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:09:09Z,use_quota=True,user_id='3157aae11a5046969ee882cf2ad1124c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Creating volume a44019aa-899c-4d98-9021-749541e4bfe0 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:09:09 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a44019aa-899c-4d98-9021-749541e4bfe0 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:09 devstack quobyte-client[83219]: System call of process 102335 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:09:09 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=168, name=volume-a44019aa-899c-4d98-9021-749541e4bfe0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a44019aa-899c-4d98-9021-749541e4bfe0 1073741824" returned: 0 in 0.367s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a44019aa-899c-4d98-9021-749541e4bfe0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a44019aa-899c-4d98-9021-749541e4bfe0" returned: 0 in 0.156s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] <== create_volume: return (637ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:09:09 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.649s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57feecae-a1bc-49fa-91f9-dab8886eae64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44019aa-899c-4d98-9021-749541e4bfe0', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6651b85-cca1-4642-9c08-4c53823cdb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:10 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume volume-a44019aa-899c-4d98-9021-749541e4bfe0 (a44019aa-899c-4d98-9021-749541e4bfe0): created successfully Sep 17 08:09:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6651b85-cca1-4642-9c08-4c53823cdb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:10 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Flow 'volume_create_manager' (1515cca1-3984-4d3d-a4a1-7937674760cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:09:10 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-705affdb-fcb8-418a-b298-f0f33d4b6a54 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Created volume successfully. Sep 17 08:09:11 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Flow 'volume_create_manager' (81286b11-27a6-43ff-bf21-2910e9469e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22fc3fc-8780-42e3-9d13-abf4512bbee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22fc3fc-8780-42e3-9d13-abf4512bbee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-541375023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03921637-ec2b-4d71-8476-5e48d04fd249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce79f2125f64f3f9130b4782a255391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:09:11Z,use_quota=True,user_id='3157aae11a5046969ee882cf2ad1124c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e89d92-fa35-4e0e-88df-1bb26d07d6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e89d92-fa35-4e0e-88df-1bb26d07d6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d5ba55-d68c-4fc7-afa2-8593a5f6b52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d5ba55-d68c-4fc7-afa2-8593a5f6b52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03921637-ec2b-4d71-8476-5e48d04fd249', 'volume_name': 'volume-03921637-ec2b-4d71-8476-5e48d04fd249', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfb629e-61de-4c8b-ae32-ad70bd0b5d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfb629e-61de-4c8b-ae32-ad70bd0b5d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e3b4ef-de8d-40d5-a28f-b2e58841d594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:11 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume 03921637-ec2b-4d71-8476-5e48d04fd249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03921637-ec2b-4d71-8476-5e48d04fd249', 'volume_size': 1} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-541375023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03921637-ec2b-4d71-8476-5e48d04fd249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce79f2125f64f3f9130b4782a255391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:09:11Z,use_quota=True,user_id='3157aae11a5046969ee882cf2ad1124c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Creating volume 03921637-ec2b-4d71-8476-5e48d04fd249 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:09:11 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:09:11 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03921637-ec2b-4d71-8476-5e48d04fd249 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:12 devstack quobyte-client[83219]: System call of process 102339 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:09:12 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=169, name=volume-03921637-ec2b-4d71-8476-5e48d04fd249, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:09:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03921637-ec2b-4d71-8476-5e48d04fd249 1073741824" returned: 0 in 0.701s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:12 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03921637-ec2b-4d71-8476-5e48d04fd249 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:13 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:09:13 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:09:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Flow 'volume_create_manager' (8aa1e2dd-8151-48cd-b154-a87ba8fdad75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:09:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f250c9d-b619-499f-b2c3-b19594204c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03921637-ec2b-4d71-8476-5e48d04fd249" returned: 0 in 0.992s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:13 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] <== create_volume: return (1932ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:09:13 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e3b4ef-de8d-40d5-a28f-b2e58841d594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03921637-ec2b-4d71-8476-5e48d04fd249', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70bf437-a8e6-4272-842d-f1fec16e8052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:13 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f250c9d-b619-499f-b2c3-b19594204c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-999022537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05fe87b8-06e9-4e33-b496-740117594d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce79f2125f64f3f9130b4782a255391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:09:12Z,use_quota=True,user_id='3157aae11a5046969ee882cf2ad1124c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b1ae0d-1a5c-4ffe-8f69-bba4abdb5d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b1ae0d-1a5c-4ffe-8f69-bba4abdb5d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2cb18b-1982-4316-8bb9-e08a200faa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c2cb18b-1982-4316-8bb9-e08a200faa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05fe87b8-06e9-4e33-b496-740117594d53', 'volume_name': 'volume-05fe87b8-06e9-4e33-b496-740117594d53', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a21f87-7a66-4381-91fb-62977e38afaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a21f87-7a66-4381-91fb-62977e38afaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19f5849-7ce4-4b42-8e25-e196c6caca08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:14 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume 05fe87b8-06e9-4e33-b496-740117594d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05fe87b8-06e9-4e33-b496-740117594d53', 'volume_size': 1} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-999022537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05fe87b8-06e9-4e33-b496-740117594d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce79f2125f64f3f9130b4782a255391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:09:12Z,use_quota=True,user_id='3157aae11a5046969ee882cf2ad1124c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Creating volume 05fe87b8-06e9-4e33-b496-740117594d53 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:09:14 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05fe87b8-06e9-4e33-b496-740117594d53 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:14 devstack quobyte-client[83219]: System call of process 102345 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:09:14 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=170, name=volume-05fe87b8-06e9-4e33-b496-740117594d53, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:09:14 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Flow 'volume_create_manager' (991b93e8-74b6-489e-9798-3f39bddaa75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f824d22-a333-441d-bbe9-266f58a855b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:14 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume volume-03921637-ec2b-4d71-8476-5e48d04fd249 (03921637-ec2b-4d71-8476-5e48d04fd249): created successfully Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70bf437-a8e6-4272-842d-f1fec16e8052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:14 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Flow 'volume_create_manager' (81286b11-27a6-43ff-bf21-2910e9469e39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:09:14 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Flow 'volume_create_manager' (21aaf81b-357b-4326-8edd-c0620d9ccd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257cd37d-f338-4ab1-a1fc-5954beab5e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (257cd37d-f338-4ab1-a1fc-5954beab5e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-710384721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e7c04b-4938-4a08-ad2e-2da67cbf5ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce79f2125f64f3f9130b4782a255391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:09:14Z,use_quota=True,user_id='3157aae11a5046969ee882cf2ad1124c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354b2807-1e2f-439b-bccd-41282cdb1fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354b2807-1e2f-439b-bccd-41282cdb1fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d36f95b-0f8d-43a4-85fe-95b711849b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d36f95b-0f8d-43a4-85fe-95b711849b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e7c04b-4938-4a08-ad2e-2da67cbf5ac9', 'volume_name': 'volume-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432f8b12-642c-43bd-8bc1-39eadef40b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432f8b12-642c-43bd-8bc1-39eadef40b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e86a69-ceb8-44e6-8e96-14549bdaeced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:15 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume 51e7c04b-4938-4a08-ad2e-2da67cbf5ac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9', 'volume_size': 1} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05fe87b8-06e9-4e33-b496-740117594d53 1073741824" returned: 0 in 1.000s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f824d22-a333-441d-bbe9-266f58a855b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-603595923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e1cfd0-4aff-43f0-9489-99d4a2a915ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce79f2125f64f3f9130b4782a255391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:09:13Z,use_quota=True,user_id='3157aae11a5046969ee882cf2ad1124c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2240f607-c6f4-4190-baaf-faeeeb082e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2240f607-c6f4-4190-baaf-faeeeb082e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3146e9b2-2ce7-40ad-bf68-dbec09085742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3146e9b2-2ce7-40ad-bf68-dbec09085742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e1cfd0-4aff-43f0-9489-99d4a2a915ed', 'volume_name': 'volume-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c09410-f1c1-4d22-8038-43b713d57831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c09410-f1c1-4d22-8038-43b713d57831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96c4daf-9efb-4073-a2b9-274afdf2e55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:15 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume c3e1cfd0-4aff-43f0-9489-99d4a2a915ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed', 'volume_size': 1} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:15 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-371c3d1e-9735-4c33-afba-d368d315604e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Created volume successfully. Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05fe87b8-06e9-4e33-b496-740117594d53 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:15 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83207) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1376}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Flow 'volume_create_manager' (b0c6b055-9eb4-4349-931a-7741440c3e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f3191c0-7ac1-4694-8e69-965c0e8e1395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05fe87b8-06e9-4e33-b496-740117594d53" returned: 0 in 0.530s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] <== create_volume: return (1707ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.710s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-710384721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e7c04b-4938-4a08-ad2e-2da67cbf5ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce79f2125f64f3f9130b4782a255391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:09:14Z,use_quota=True,user_id='3157aae11a5046969ee882cf2ad1124c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Creating volume 51e7c04b-4938-4a08-ad2e-2da67cbf5ac9 {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:09:15 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:09:15 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:16 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=171, name=volume-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f3191c0-7ac1-4694-8e69-965c0e8e1395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1203145073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a66bbbb-bb98-4807-8670-540fbfbb123d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce79f2125f64f3f9130b4782a255391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:09:14Z,use_quota=True,user_id='3157aae11a5046969ee882cf2ad1124c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138a0b34-f15a-46be-a889-7d6017a4c357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138a0b34-f15a-46be-a889-7d6017a4c357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e10f42f-f5f6-4bfe-b832-84c6c5174a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e10f42f-f5f6-4bfe-b832-84c6c5174a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a66bbbb-bb98-4807-8670-540fbfbb123d', 'volume_name': 'volume-2a66bbbb-bb98-4807-8670-540fbfbb123d', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9de7d6-dce2-40a0-800d-a3bb4bb1e5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9de7d6-dce2-40a0-800d-a3bb4bb1e5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f070d369-680d-4a06-acd8-9755af5d4a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:16 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume 2a66bbbb-bb98-4807-8670-540fbfbb123d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a66bbbb-bb98-4807-8670-540fbfbb123d', 'volume_size': 1} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9 1073741824" returned: 0 in 0.516s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19f5849-7ce4-4b42-8e25-e196c6caca08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05fe87b8-06e9-4e33-b496-740117594d53', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fedd8959-2211-4294-b647-97b3329ec448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9" returned: 0 in 0.343s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] <== create_volume: return (888ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-603595923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e1cfd0-4aff-43f0-9489-99d4a2a915ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce79f2125f64f3f9130b4782a255391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:09:13Z,use_quota=True,user_id='3157aae11a5046969ee882cf2ad1124c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Creating volume c3e1cfd0-4aff-43f0-9489-99d4a2a915ed {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:09:16 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:09:16 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:16 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume volume-05fe87b8-06e9-4e33-b496-740117594d53 (05fe87b8-06e9-4e33-b496-740117594d53): created successfully Sep 17 08:09:16 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=172, name=volume-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fedd8959-2211-4294-b647-97b3329ec448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Flow 'volume_create_manager' (8aa1e2dd-8151-48cd-b154-a87ba8fdad75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e86a69-ceb8-44e6-8e96-14549bdaeced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f947d99-14ab-4e8b-8143-0d8e868c0bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:17 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-2985886c-ac9c-4775-be40-446c8d3481da tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Created volume successfully. Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed 1073741824" returned: 0 in 0.571s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:17 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume volume-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9 (51e7c04b-4938-4a08-ad2e-2da67cbf5ac9): created successfully Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f947d99-14ab-4e8b-8143-0d8e868c0bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Flow 'volume_create_manager' (21aaf81b-357b-4326-8edd-c0620d9ccd8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed" returned: 0 in 0.392s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] <== create_volume: return (997ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:17 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-5b4cfa9e-b811-4d0a-a465-2f4a62e0ad7e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Created volume successfully. Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.475s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-17T06:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1203145073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a66bbbb-bb98-4807-8670-540fbfbb123d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce79f2125f64f3f9130b4782a255391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-17T06:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-17T06:09:14Z,use_quota=True,user_id='3157aae11a5046969ee882cf2ad1124c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed8a7f64-a2e8-41a3-aaf9-16d20dc940de),volume_type_id=ed8a7f64-a2e8-41a3-aaf9-16d20dc940de)}" {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.remotefs [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Creating volume 2a66bbbb-bb98-4807-8670-540fbfbb123d {{(pid=83207) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Selected 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe as target Quobyte volume. {{(pid=83207) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 17 08:09:17 devstack cinder-volume[83207]: INFO cinder.volume.drivers.remotefs [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] casted to 10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe Sep 17 08:09:17 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2a66bbbb-bb98-4807-8670-540fbfbb123d 1073741824 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:17 devstack quobyte-client[83219]: System call of process 102358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 17 08:09:18 devstack quobyte-client[83219]: The server volume:b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b7d2ae4b-2bc8-4ccd-aa82-f7a9534a9d14, inode=173, name=volume-2a66bbbb-bb98-4807-8670-540fbfbb123d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.170), requestorAccessMask=0 Sep 17 08:09:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f96c4daf-9efb-4073-a2b9-274afdf2e55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e053ec-a587-44e1-8920-afcd312fa1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:18 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume volume-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed (c3e1cfd0-4aff-43f0-9489-99d4a2a915ed): created successfully Sep 17 08:09:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e053ec-a587-44e1-8920-afcd312fa1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Flow 'volume_create_manager' (991b93e8-74b6-489e-9798-3f39bddaa75f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:09:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2a66bbbb-bb98-4807-8670-540fbfbb123d 1073741824" returned: 0 in 0.502s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:18 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-29ca2fd2-a16c-4eae-aecd-a2ccedb59a95 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Created volume successfully. Sep 17 08:09:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2a66bbbb-bb98-4807-8670-540fbfbb123d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2a66bbbb-bb98-4807-8670-540fbfbb123d" returned: 0 in 0.197s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:18 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] <== create_volume: return (749ms) {'provider_location': '10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'} {{(pid=83207) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 17 08:09:18 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f070d369-680d-4a06-acd8-9755af5d4a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a66bbbb-bb98-4807-8670-540fbfbb123d', 'volume_size': 1}' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a8fc88-79c8-474a-baf8-5b69c885c949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 17 08:09:18 devstack cinder-volume[83207]: INFO cinder.volume.flows.manager.create_volume [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume volume-2a66bbbb-bb98-4807-8670-540fbfbb123d (2a66bbbb-bb98-4807-8670-540fbfbb123d): created successfully Sep 17 08:09:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a8fc88-79c8-474a-baf8-5b69c885c949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83207) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 17 08:09:18 devstack cinder-volume[83207]: DEBUG cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Flow 'volume_create_manager' (b0c6b055-9eb4-4349-931a-7741440c3e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83207) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 17 08:09:18 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-bd7b406f-add6-4bd1-aec9-dbd209910b3b tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Created volume successfully. Sep 17 08:09:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "cinder-2a66bbbb-bb98-4807-8670-540fbfbb123d-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:09:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-2a66bbbb-bb98-4807-8670-540fbfbb123d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:09:19 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:09:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "cinder-quobyte-2a66bbbb-bb98-4807-8670-540fbfbb123d" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:09:19 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-quobyte-2a66bbbb-bb98-4807-8670-540fbfbb123d" acquired by "delete_volume" :: waited 0.013s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:09:19 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d81943-26aa-4d37-ad9e-adfc4db6b49e]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:09:19 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2a66bbbb-bb98-4807-8670-540fbfbb123d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2a66bbbb-bb98-4807-8670-540fbfbb123d" returned: 0 in 0.439s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2a66bbbb-bb98-4807-8670-540fbfbb123d {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-2a66bbbb-bb98-4807-8670-540fbfbb123d" returned: 0 in 0.103s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:20 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-quobyte-2a66bbbb-bb98-4807-8670-540fbfbb123d" released by "delete_volume" :: held 0.693s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:20 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Created reservations ['2d6a568d-9757-417d-a78f-9697b8cb9284', 'f88aea27-ffd4-4f8f-acb4-8ed38f051c47', 'ecaa2b72-5fbe-42d8-be0e-d483212db5f6', '11baccf7-7d7e-4ecd-8f22-9b341185bbbe'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:09:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:20 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:20 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.105s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:21 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:09:21 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Deleted volume successfully. Sep 17 08:09:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-d1cd62be-93e0-4d83-a0a1-5426fc33477c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-2a66bbbb-bb98-4807-8670-540fbfbb123d-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "cinder-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:09:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:09:21 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:09:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "cinder-quobyte-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:09:21 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-quobyte-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9" acquired by "delete_volume" :: waited 0.018s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:09:22 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeed695d-67cc-48e3-b6fe-7cc0fbffea71]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:09:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9" returned: 0 in 0.414s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:22 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9" returned: 0 in 0.107s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:22 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-quobyte-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9" released by "delete_volume" :: held 0.663s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:22 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Created reservations ['b09a7cff-4e82-4f18-83a7-b2a726bda0d5', '01572900-bee7-46b5-8f6d-22995af781b3', '503a2423-a530-4d3d-a419-d241456cefe3', '206272e1-326a-4591-b6d2-edc4f6873d3d'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:09:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:23 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:23 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.117s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:23 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:09:23 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Deleted volume successfully. Sep 17 08:09:23 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-61ca3cf4-ac2a-407d-a4f0-a347b6c22aab tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-51e7c04b-4938-4a08-ad2e-2da67cbf5ac9-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "cinder-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:09:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:09:24 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:09:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "cinder-quobyte-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:09:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-quobyte-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed" acquired by "delete_volume" :: waited 0.016s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:09:24 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb06f12-d94b-4c1f-85af-44b224d6f848]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:09:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed" returned: 0 in 0.442s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:24 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed" returned: 0 in 0.091s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:24 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-quobyte-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed" released by "delete_volume" :: held 0.693s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:25 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Created reservations ['76f86d1b-1b1d-4d94-becc-edc66bb1865e', 'b20333e3-33b3-47cc-8f08-7119f7640c45', '16e3577b-0d85-46eb-b3e1-acc7808ca077', '35f7ab59-01c1-4371-93c7-108d381892bd'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:09:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:25 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:25 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.101s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:25 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:09:25 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Deleted volume successfully. Sep 17 08:09:25 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-32608625-ba77-486c-8ff4-82138c4f4e0d tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-c3e1cfd0-4aff-43f0-9489-99d4a2a915ed-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "cinder-05fe87b8-06e9-4e33-b496-740117594d53-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:09:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-05fe87b8-06e9-4e33-b496-740117594d53-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:09:26 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:09:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "cinder-quobyte-05fe87b8-06e9-4e33-b496-740117594d53" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:09:26 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-quobyte-05fe87b8-06e9-4e33-b496-740117594d53" acquired by "delete_volume" :: waited 0.012s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:09:26 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[47949d03-7e65-4d40-abed-b23bc29cf3da]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:09:26 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05fe87b8-06e9-4e33-b496-740117594d53 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05fe87b8-06e9-4e33-b496-740117594d53" returned: 0 in 0.417s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05fe87b8-06e9-4e33-b496-740117594d53 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-05fe87b8-06e9-4e33-b496-740117594d53" returned: 0 in 0.112s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:27 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-quobyte-05fe87b8-06e9-4e33-b496-740117594d53" released by "delete_volume" :: held 0.681s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:27 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Created reservations ['dd3b80ed-2971-4bbb-825d-89ba18752d04', '61d69b5b-27b2-4217-af29-9a5803d286a1', '5024cae7-88d2-4b8a-9129-f16c34c16870', '4151637c-bd4d-42a7-8e20-837f92ae44e4'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:09:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:27 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:27 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.112s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:27 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:09:27 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Deleted volume successfully. Sep 17 08:09:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-9a47c985-1737-41de-842b-13119ef1c26c tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-05fe87b8-06e9-4e33-b496-740117594d53-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:28 devstack cinder-volume[83207]: DEBUG oslo_service.periodic_task [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83207) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 17 08:09:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:28 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:28 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.088s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:28 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-f5001a34-6cb3-49e2-bb01-2167acf38ee7 None None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:09:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "cinder-03921637-ec2b-4d71-8476-5e48d04fd249-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:09:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-03921637-ec2b-4d71-8476-5e48d04fd249-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:09:28 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:09:28 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "cinder-quobyte-03921637-ec2b-4d71-8476-5e48d04fd249" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:09:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-quobyte-03921637-ec2b-4d71-8476-5e48d04fd249" acquired by "delete_volume" :: waited 0.014s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:09:29 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b7f648-e3df-4714-b137-8626f60eda5b]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:09:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03921637-ec2b-4d71-8476-5e48d04fd249 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03921637-ec2b-4d71-8476-5e48d04fd249" returned: 0 in 0.429s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03921637-ec2b-4d71-8476-5e48d04fd249 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:29 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-03921637-ec2b-4d71-8476-5e48d04fd249" returned: 0 in 0.104s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:29 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-quobyte-03921637-ec2b-4d71-8476-5e48d04fd249" released by "delete_volume" :: held 0.719s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:30 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Created reservations ['5c284a53-c477-42a1-a8c7-b0613f0ccf5e', '75ccf73e-7e9c-4329-a6f6-db1ab05865de', 'd45e28d2-b084-4d97-b67c-f4dedbc0cf4f', '3c793759-7244-46c6-b757-8d4a64917480'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:09:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:30 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:30 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.081s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:30 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:09:30 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Deleted volume successfully. Sep 17 08:09:30 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=155,cinder:SELECT=99,cinder:INSERT=31,cinder:DELETE=14 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:09:30 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-db18f4b7-17ec-4e5a-96d0-d8ba2c0a342e tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-03921637-ec2b-4d71-8476-5e48d04fd249-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:30 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "cinder-a44019aa-899c-4d98-9021-749541e4bfe0-delete_volume" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:09:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-a44019aa-899c-4d98-9021-749541e4bfe0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:09:31 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=98,cinder:UPDATE=154,cinder:DELETE=12,cinder:INSERT=41 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:09:31 devstack cinder-volume[83207]: WARNING cinder.volume.volume_utils [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 17 08:09:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "cinder-quobyte-a44019aa-899c-4d98-9021-749541e4bfe0" by "delete_volume" {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 17 08:09:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-quobyte-a44019aa-899c-4d98-9021-749541e4bfe0" acquired by "delete_volume" :: waited 0.015s {{(pid=83207) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 17 08:09:31 devstack cinder-volume[83207]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2e6af4-63fa-41b7-bed4-3b2fe879b474]: (4, 'qcow2') {{(pid=84353) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 17 08:09:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a44019aa-899c-4d98-9021-749541e4bfe0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a44019aa-899c-4d98-9021-749541e4bfe0" returned: 0 in 0.421s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a44019aa-899c-4d98-9021-749541e4bfe0 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:31 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "rm -f /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7/volume-a44019aa-899c-4d98-9021-749541e4bfe0" returned: 0 in 0.100s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:31 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-quobyte-a44019aa-899c-4d98-9021-749541e4bfe0" released by "delete_volume" :: held 0.666s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:32 devstack cinder-volume[83207]: DEBUG cinder.quota [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Created reservations ['7d6df432-dbad-4e8c-b51a-83114bfbe5fc', '12d38928-3175-4b10-a361-7de95d51aaa0', 'bc7b9779-a6c6-4cc6-ae16-8421128ddcaa', 'bd3fe27e-fa43-438a-aeb0-b007e03336d4'] {{(pid=83207) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 08:09:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 17 08:09:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 17 08:09:32 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe': None} {{(pid=83207) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 17 08:09:32 devstack cinder-volume[83207]: DEBUG cinder.volume.drivers.quobyte [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Available shares ['10.10.41.181/cinder-vol-cf39aecc-485f-4f1c-8890-e37c2e3c63fe'] {{(pid=83207) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 17 08:09:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.lockutils [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83207) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 17 08:09:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7 {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 17 08:09:32 devstack cinder-volume[83207]: DEBUG oslo_concurrency.processutils [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/765700709d44ba5d790a4f1edba857d7" returned: 0 in 0.102s {{(pid=83207) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 17 08:09:32 devstack cinder-volume[83207]: DEBUG cinder.manager [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Notifying Schedulers of capabilities ... {{(pid=83207) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 17 08:09:32 devstack cinder-volume[83207]: INFO cinder.volume.manager [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Deleted volume successfully. Sep 17 08:09:32 devstack cinder-volume[83207]: DEBUG cinder.coordination [None req-a78dc994-f820-43cd-8db9-0f1deb849522 tempest-CreateVolumesFromSourceVolumeTest-517162444 None] Lock "cinder-a44019aa-899c-4d98-9021-749541e4bfe0-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=83207) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 17 08:09:42 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 17 08:09:42 devstack cinder-volume[83207]: DEBUG dbcounter [-] [83207] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83207) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}